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A) THE FIRST YEAR'S 


WW © ISSUE IN BOUND ee 
= FORM we wi ‘Talking |t Over 


of us A course in discussion guidance 

An invaluable “Handbook’’ vena for some of our faculty members will 
, ° z= rs and be started soon. We feel that the last 

of Leadership Training Eccl two issues, particalarly, of ADULT 


Ideas and Service for 3 tech- LEADERSHIP, would be of excep- 


y were tional value to them. (January and 


Permanent Reference any of February, 1953.) Please accept my 


eaders congratulations for creating a most 


cation. valuable and interesting magazine. 
hiloso (CHARLES VAN WAY, JR., Colo- 
evalu nel, Inf. U.S.A, Industrial College of 
, these the Armed Forces, Washington, 
oals as D. C.) 


us and For the Forgotten Folks . . . 


mittee. Your February issue of ADULT 
rt were LEADERSHIP received and read 


Getting and Keeping 1 well with much enthusiasm. Who knows 

Members large ly but what ADULT LEADERSHIP has 

aie: Leading Large Meetings if view come into the world at a time like 

Program Planning a re per on a this to challenge adults like myself, 

Spotlight on Leadership : Seles of qreup momen mental the some 7 million of us retired folks, 
Using Resources wie sie eh: , papsine inert 


in the the forgotten of God and neglected 
ements by men. Seven million retired folks 
s 5 Initiating social action with some 70 million years of exist- 
Working Toward Goals Bae Leading Discussions when ence remaining for them, Can it be 
The Group in the Com- § Improving Evaluation experi that ADULT LEADERSHIP will 
Prete This is blaze a new and glorious trail for 
xe than them! (WILLIAM H. DREIER, “The 
ver trv Old Dreier Farm,” Hubbard, lowa.) 
Special Features: 9 === aseribe 

Tool Kits —— pecause A Valuable Library .. . 
Resources — s. If a 
Consultation ie next 
Ispices. 


The cost of the sample copy of 
ADULT LEADERSHIP which you 


‘ sent me was a good investment I 
isposed 


think. I prize my subscription and 
feel that month by month I am build 
to per ing a valuable library, | recommend 


THE FIRST COMPLETE . help er ae ee 


" A trend which seems to be deve lop 
) V{ | ME 4 uations ing in the editorial policy of the 
. | : 5 without magazine is becoming ine reasingly of 


hich is interest to me. There seems to be 


a ; ceeping only one sort of individual who is 


t better continually turned to as the depend 


ADL LT _ . ss * e reer able speaker and the one who can 

* ce © . ; gy a6 s ; % it whl h help the froup see itself and under 

@e = I iy sf & . | » better stand its problems. Who is he? He’s 

F yr a wes % ~ : n terms the university professor! (DONALD 
An experiment in ieacersniy nning-—now Buc- To im R ROBE RTS. T ; 

 mirneuetiee area “ o ; MUS, Training Director, J. 

cess! ADULT LEADERSHIP’S initial eleven ifBues srning Director, J 


: 1 more y RP § - lew (‘ali 
have effectively gathered together dependable F. Hink & Son, Berkeley, Calif.) 


® 


1 


knowledge, practical theory, useful techniques and med to [1 this is true, we should avoid it. 
exciting social inventions to help make your group There are many others who serve 
activities more successful. There are only a limited > judg groups in this way.The Editors. | 

number of bound volumes available—so send in efforts 


continued on page 30 
your order now. 
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@ The plan for this issue of ADULT LEADERSHIP dida’t come easy 
to us, the Issue Committee, when we sat down to work it out together 
last November. Part of the difficulty, we soon discovered, came from the 
diverse kinds of evaluation experiences which different ones of us 
brought to the committee. Some of us, practitioners in adult programs, 
were very much aware of the practical difficulties that leaders and 
teachers have in finding time and building readiness for intensive self 
evaluation. Others came out of a background of experience as tech 
nicians and consultants in survey and evaluation research. They were 
concerned that the technical aspects of program evaluation, many of 
these greatly improved in recent years, be communicated to the readers 
of ADULT LEADERSHIP accurately and without oversimplification. 
Still others of us looked at the evaluation proble m primarily as philoso 
phers or generalists. Emphasizing the meaning and importance of evalu 
ation as a steering mechanism for all intelligent human activity, these 
members insisted that attention be given to the evaluation of goals as 
well as methods. 

It took time and effort to reconcile these diversities among us and 
to produce a plan which was acceptable to everyone on the committee 
But we became convinced, as we worked, that this time and effort were 
well-spent. If we have been able to achieve a many sided and well 
balanced treatment of program evaluation in this issue, it is due largely 
to the challenge of diverse experiences emphase s and points of view 
which we had to meet. 

We were able, as we worked together, to reach some fundamental 
agreements about the meaning and importance of evaluation in the 
improvement of adult programs. Perhaps a review of these agreements 
will help to clarify the plan of this issue. 

We recognized that evaluation, in its broadest sense, occurs when 


ever people make value judgments about the things they do or exper! 


ence. Everyone makes such judgments every day of his life. “This is 
a nicer day than yesterday.” “I think I did a better job this time than 
I ever did before.” “That was a really lousy meeting.” “ll never try 
that again—it didn’t do anyone any good.” Such judgments ascribe 
value, plus or minus, to things and actions. They are important because 
people use them as a basis for their future choices and actions. If a 


person thinks a meeting was a flop, he is likely not to go to the next 
one whic h uses the same speaker or 1s he ld under the same auspices 
If he thinks the meeting was just what he needed, he will be pre dispose d 


to attend the next time he has a chance. 


The educational problem with respect to evaluation is not to per 
suade people to make value judgments. They will be doing this any 
way, whatever others may think of the results. The problem is to help 
people make better evaluations. 


It isn’t hard to spot the two most ty pir al ways in which evaluations 
need to be improved, 1) Many value judgments are made without 
much dependable factual evidence about the thing or action which is 
heing judged good Or bad successful or unsuccessful, worth keeping 
or not worth keeping. To improve such judgments means to get better 


2) Frequently, value judgments are made 


evidence into the judgment. ( 
without any clear vision of the standards or goals in terms of which 
the thing or action is being judged. Meeting A may be said to be better 
than meeting B. But it is often hard to say by what standards or in terms 
of progress toward what goals A is judged to be better than B. To im 
prove judgments faulty in this way means to get a clearer and more 
critical vision of the goals and standards our actions are designed to 
BeT Ve 

In a general way, what we have just said about the value judg 


ments that individuals make applies equally well to concerted efforts 
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wy Talking |t Over 


For Faculty Discussions .. . 

A course in discussion guidance 
for some of our faculty members will 
be started soon. We feel that the last 
two issues, particularly, of ADULT 
LEADERSHIP, would be of excep- 
tional value to them. (January and 
February, 1953.) Please accept my 
congratulations for creating a most 
valuable and interesting magazine. 
(CHARLES VAN WAY, JR., Colo- 
nel, Inf. U.S.A. Industrial College of 
the Armed Forces, Washington, 
Bo £3 


For ihe Forgotten Folks .. .« 


Your February issue of ADULT 
LEADERSHIP received and read 
with much enthusiasm. Who knows 
but what ADULT LEADERSHIP has 
come into the world at a time like 
this to challenge adults like myself, 
the some 7 million of us retired folks, 
the forgotten of God and neglected 
by men. Seven million retired folks 
with some 70 million years of exist- 
ence remaining for them. Can it be 
that ADULT LEADERSHIP will 
blaze a new and glorious trail for 
them! (WILLIAM H. DREIER, “The 
Old Dreier Farm,” Hubbard, lowa.) 


A Valuable Library .. . 


The cost of the sample copy of 
ADULT LEADERSHIP which you 
sent me was a good investment I 
think. I prize my subscription and 
feel that month by month | am build 
ing a valuable library, | recommend 
the magazine to some new person 
every week it seems. 

A trend which seems to be de velop 
ing in the editorial policy of the 
magazine is becoming increasingly of 
interest to me, There seems to be 
only one sort of individual who is 
continually turned to as the depend 
able Spe aker and the one who can 
help the group see itself and under 
stand its problems. Who is he? He’s 
the university professor! (DONALD 
R. ROBERTS, Training Director, J. 
F. Hink & Son, Berkeley, Calif.) 

[1 / this is true, we should avoid it. 
There are many others who serve 
groups in this way.-The Editors. | 


continued on page 30 
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in adult prog 


to duce participants lo 
about hov 


well different parts of the program are func 


lion w hi ‘ my are erving thei purposes or not 
Participant ucn judgments anyway. The 
problem ji © induce participants to improve their 
evaluati ol program purposes, methods and results 
And imps ent in these a | other evaluations means 
etling ft qote dependable evide f into the jud tiie nts and 
ind criticizing the goals and standards used 
ince program evaluation ree 4 jud ments from a 


froup of peopl rather than from 


clarify 


in individual, its im 
provement requires in addition effective ways of pooling 
the judgments of individual partis ipants and of building 
i common judgment as a basis for further joint action 
The articles in this issue evidence and the 


portance wi el ir goals 


lim 
our judgment of how pro 
d to hye in 


brat evaluate ity nee 


tim 


proved at the present 
Ihe Committee agreed further that the most im 
portant re ults of adult programs lie in what they do to 
the peo} le who take part, It is easier to gather facts about 
non-human a pects ofa program how much money was 
raised and pent or how much new building was accom 
pli hed, for ex my le than to find out how the program 
affected the peopl involved their knowledge, attitudes 
relation hips, mental health and morale. It is not surpris 
ing, therefore that program evaluations frequently 
overstress the non-human and understress the more im 
portant human aspects. Because of this typ al imbalanes 
we have emphasized, in the Tool Kit, the case story, 


ind elsewhere in this issue, the study and interpretation 


y 
ae 


—— 


| 


That one in the black has an awfully skinny neck.” 


| hvaluation ian't the same as measurement, | 


of the human effects of adult programs in evaluation. 
We found little trouble agreeing that the full value 
of systematic evaluation comes only when it is accepted 
and used as a regular and continuing part of program 
planning and operation. We believe that such evaluation 
provides five important services to adult leaders: 
1. It helps them to locate where their ways of think 
ing and doing need to be improved; 
2. It helps them learn what they need to do in order 


to improve; 


». It he Ips keep programs abreast of a changing en- 
vironment—local, national and international. 

4. It vives them security in knowing how well they 
are doing, without having to seek security by fool 
ing themselves and others; 

5. It he Ips them keep their specialized practice s and 
programs geared lo larger, general goals whi h 
should permeate all specialized activities 


We on the Committee became aware as we talked 
that there are inescapable obstacles practi al, intellee- 
tual, moral and political—to full acceptance of contin- 
ving, systematic evaluation as a part of all pro rramming. 
We decided to devote two pieces, “Hurdles for Evalua- 
tors,” by the committee, and “What Price Honesty?” by 
Charles E. Hendry, to probing barriers to the full use of 
evaluation in adult programs. Harry Lerner urged also 
that adult leaders, like everyone else, find difficulty in 
keeping an eye on the forest because of their concentra- 
tion on their own special trees. The committee agreed. 
So we planned for one article which looks evaluatively 
not at any one adult program but at the whole American 
adult education movement in 1953. 

These were some of the general agreements and 
specifi decisions whi h our Committee reached as it 
worked together. The materials which committee mem- 
bers decided to prepare fell into three general blocks. 
Each of three sub-groups assumed responsibility for writ 
ing one of these blocks of materials. Wilbur Hallenbeck, 
Benjamin Shangold and Kenneth Benne undertook to 
write “Among Ourselves.” “Hurdles for I valuators” and 
“The Evidence of Things Hoped For-” (Max Corey also 
helped to revise this last article.) Bernard Kutner, Homer 
Kempfer, Harry Lerner and Robertson Sillars worked 
on the Tool Kit and “Evaluating Goals.” Winifred Fisher, 
Max Corey and Gilbert Laue undertook to prepare the 
case material and analysis. Harry Lerner took initiative 
in getting the interviews on the adult education move 
ment carried through. 

The Committee at some stage in its deliberation 
recognized that the experience of ADULT LEADERSHIP 


with its own evaluation might provide 


an appropriate 
true story for this, the final issue of its first year of 
publication. We reviewed the efforts of the magazine to 
a regular 
part of its operation. We recognized that in terms of the 
high hopes which went into it this evaluation attempt 
was not very successful. Because of dissatisfaction with 


its first year’s evaluation, the magazine is launching a 


establish continuing evaluation by readers as 


new and, we hope, better program of evaluation during 
its second year of ope ration. We asked the Editorial Staff 
to outline this story of past attempts and future plans. 
Their accounting appears on the “Feedback” page 


adult leadership 
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What Price Honesty? 


by Charles E. Hendry, Director, School of Social Work 
University of Toronto, Toronto, Canada 


Charles Hendry writes this article out of a rich and varied experience 
as research director in a number of adult organizations. Feeling the strug- 
gle between administrative mind and research mind in the appraisal of 
program and performance, he has thought seriously both about the reasons 
for this struggle and about the ways it should be treated. His reflections 
on how to be honest in evaluating a program can be a challenge to admin- 
istrators, researchers, volunteer leaders and teachers alike. Charles FE. 
Hendry is the author of The Role of Groups in World Reconstruction, 


recently published by The Woman’s Press. 


Ww do adult leaders, particularly administrative 
leaders in organizations, often tend to shy away 


from impartial and honest evaluation? This reaction to 
evaluation research certainly occurs in many youth-serv 
ing organizations. The following story shows this clearly. 
And the Same reat tion ! probably not too uncommon in 


other organizations as well. 


Good Intentions May Conceal Bad Results 


Back in the late twenties a highly significant asses 
ment was made of a number of agencies and programs 
with goals of building character in young people. The 
evaluation was directed by two distinguished social sci 
entists, Mark May and Hugh Hartshorne. They assembled 
a remarkably able staff and designed an ingenious re 
search project to find out how well program goals were 
being met. The project was known as the Character 
Education Inquiry. 


The publi hed report of the study created wide 
spread concern and violent reactions among organiza 


tional leader The findings were devastating. 


One conclusion was that when youngsters were 
given opportunities to cheat and be dishonest, those who 
took part in Sunday School, Scouts and other similar 
character building pro rams vave as much evidence of 
deceitful behavior as those, otherwise comparable in 
background, who did not participate at all. As a matter 
of fact, it was found that in certain youth-serving organ 
izations the more successful a member was in moving 
up the achievement scale the more disposed he was to 
be dishonest. 


This and other findings strongly indicated that th 
programs were falling short of their character-building 
goals. But instead of using the study as a basis for im 
provir y and re building, many le ide rs vigorously re jecte d 
the whole evaluation. 


Why Was Honest Evaluation Attacked? 


Two facts need to be borne in mind in explaining 
the violent reception accorded the Hartshorne and May 
report by many leaders, particularly by administrators 
The first is that in the early twenties the psychological 
testing movement, hitherto largely confined to the field 
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of abstract mental ability, intelligence and aptitudes, wa 
for the first time invading the field of religious practice, 
character education and moral behavior. ‘The second i: 
that the most articulate and dominant leaders in the broad 
field of non-school, informal education, popularly re 
ferred to as the character-building avencies, were veri 
table buccaneers. They were men who took bold initiative 
in meeting an urgent, unmet need, and who threw them 
or Girls’ Work with all the dedication 
of soc ial pioneers. They were hich powered and high 


selves into Boy 
minded promoters, competing for the time and enthusi 
asm of the younger generation. They operated under the 
conviction that they were engaged in a holy cause. Their 
interest was not in research and evaluation but in o1 
ganization and promotios Any study that sought to 
enlarge the member hip or extend the movement wa 
received with satisfaction; any tudy directed toward 
evaluating the experience of members and the effective 
ness of program was re isted with su picion Research 
iimed at evaluation, they thought implied that there wa 
omething wrong with the program, the leadership or 
the organization. This assumption they flatly rejected and 
with it research itself. 


Research Under Difficulty 


One vivid episode which occurred as recently a 
1940 in one of the largest youth-serving organization 
on this continent illustrate this su picion of research 
rather well. A change had just been made in the leader 
hip of the research department in the national head 
quarter Budget increases had made it yp ible to enlarge 
the research staff. One of the first move made by the 
new research director was to recommend the appoint 
ment of a panel of research consultants. One of the con 
sultants nominated was Hugh Hart horne The mere men 
tion of his name in this connection was considered an 
impropriety hy some of the organization’s leaders. The 
then executive head of the organization resisted the pro 
posal with all the per onal power and administrative 
authority at his command. “Why consult with a man 
who has already done so much to shatter confidence in 
this organization and in all character-building agencies? 
Why deliberately expose the organization to a man who 
obviously dor not believe in it?” The research taff 
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held steady and in due course, after much heated di 
cussion, Dr. Hartshorne was officially named to the Ad 
visory Research Committee. 

But the basic resistance to research persisted, It 
reappeared dramatically at a special conference of na 
tional staff executives called to consider a report of pro 
posals for the new and enlarged research program. Much 
devoted labor had gone into designing a series of research 
projects, In the main, they were focused on studies of 
leadership, leader hip of small groups and leadership in 
relation to its actual effects on the behavior, attitude 
values, knowledge and abilities of the members. The 
methods and technique ‘ proposed took advantage of the 
latest advances in the human sciences 

One by one, each of the major project proposals 
wi ummarized and explained In his opening remarks, 
the research director had stressed the point that research 
provide an organization with ystematic, disciplined 
and responsible self-criticism. He had also paid high 
tribute to the impressive achievements of the organiza 
tion in serving the nation’s youth through many year 
Suddenly, and without any warning, while the research 
director was outlining one of the most important pro 
po als, the chief executive rose to his feet, smote his 
cane on the table and punctuated the presentation with 


this accusation “Gentlemen, | brand such talk sheer 


di loy ilty ! 


It was actually deep loyalty, lovalty to youth, loyalty 
to profession and loyalty to science that fortified the 
research staff to continue its work under the impact of 
such fierce and fanatical fury. 


By exercising unbounded self-restraint and diplo 


macy the research staff managed to salvage much of its 
projected program and to carry it to a successful com- 
pletion. World War I, the gradual loss of key member 
of the research staff to military service, the death of the 
chief executive and the appointment of a successor who 
had even less respect for research than his predecessor. 
combined, in due course, to reduce the research program 


to a minor operation, 


It's a Local Problem Too 


If this kind of attitude toward honest evaluation is 
found in the headquarters of large national organiza 
tions, what attitudes toward evaluation operate at the 
local level, and more particularly in the supervision of 


leaders directly related to actual groups? 


A large number of young adults and adults are 
found in leadership positions. every summer in organ- 
ized camps. Some of the e camps are relatively autono 
mous, even when they are affiliated with local units of 
national organizations. Some are independent of any 
national organization. The important point here is that 
leaders in camps, like leaders in thousands of other local 
organizations, face the need to evaluate their operations 
every year. An analysis of evaluation experiences in 
camps may give us some clues as to how tension, con 
flict and outright dishonesty can be reduced or elimi 
nated in attempts at objective appraisal of local pro 


grams, 


Four kinds of attitudes toward camping complicate 
evaluation. There is a widespread tendency to take the 


value of camping for granted. The popularity of the 
organized camp is accepted as an adequate measure of 
its success. This attitude is often protected by the rela- 
tive nmmunity of many camps, because of their location, 
from public scrutiny. Closely related is the view that the 
most important outcomes in a camping experience are 
spiritual and intangible and that they, therefore, defy 
evaluation. Any attempt to measure results is regarded 
as a kind of academic impertinence verging on sacrilege. 
\ third attitude may partially account for this view. It 
is the rather naive assumption that appropriate and ade- 
quate techniques for appraisal are unavailable. Nothing 
could be further off-center. And even some who are 
familiar with the fact that highly developed techniques 
for evaluation are readily at hand—and this constitutes 
the fourth attitude—will argue that evaluation is some- 
thing for the “expert,” that it is beyond the competence 
of the average camp director and staff to make an ade- 
quate impartial appraisal of their program. 

Lying back of these attitudes and the resistances to 
self-objective evaluation they release in camps, in agen- 
cies and in adult education programs generally, is an 
educational tradition. This tradition establishes evalua- 
tion as the prerogative, even the monopoly, of those in 
educational authority. Evaluation frequently is viewed as 
a tool of administration, not of education. Accordingly, 
evaluation has come to be something to be feared by its 
subjects. Actually, careful thought shows that evaluation 
is one of four indispensable steps in any process incor- 
porating educational development. These steps are: (1) 
determining objectives; (2) formulating a plan of ac- 
tion; (3) carrying out the plan, and (4) evaluating the 
results. All persons and interests involved in the educa- 
tional process should be involved as partners in evalu- 
ation as in each of the other steps. Leaders, whether they 
be administrative, supervisory or those directly related 
to persons in groups, have no justifiable monopoly on 
evaluation. 


In other words, adult attitudes toward evaluation 
today are the product of patterns of education yesterday 
in which pupils in school, students in colleges and uni- 
versities, and members in many different voluntary or- 
ganizations have been; barred from any genuine sharing 
in evaluation. Evaluation has been something done to 
them not with them. Except in rare instances, evaluation 
has not been a partnership between adults in authority 
and the members of classrooms, clubs, groups and teams. 
Among the consequences flowing from this unfortunate 
practice is a pervasive resistance to evaluation and a 
basic conflict between evaluation as inquiry into the ef- 
fectiveness of program and performance, on the one 
hand, and evaluation as justification or punishment, on 
the other. 


Fostering Honest Evaluation 


If evaluation—self-objective, honest evaluation—is 
to be woven into the fabric of programs of adult educa- 
tion and adult action, it follows that some realistic strat- 
egy will have to be devised to identify areas and degrees 
of readiness and resistance to evaluation in organizations. 
It follows further that deliberate experimentation will 
have to be attempted to discover the best ways of ad- 


adult leadership 
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vancing evaluation against suspicion and distrust. An a person of still greater status and 
| . . 

evaluation of ways of introducing and initiating evalu- 

ation is clearly called for. 


prestige, someone 
higher up on the totem pole, who supports and sanctions 
it. If an agency board, an administrator or a group carry- 
ing responsibility for a program frankly admit that they 
don’t know the answers to what everyone recognizes as 
started and carried through successfully, where readiness a really difficult problem, they will help create a readi- 
for it can be cultivated. Too often evaluation fails because ness for research throughout their 
it is initiated from outside, psychologically speaking. 
Often the first efforts are much too much on the grand 


Only a few general hints about strategy are possible 
here. Evaluation, like any other activity, can only be 


organization, Some- 
times this latent hospitality to evaluation can be developed 
if research-minded leaders deliberately talk the language 


scale. Often its technical requirements appear to demand of those in control. For example, terms for research tools 


a sophistication which frightens and immobilizes admin 
istrators and leaders alike, however hospitable they a 
tually may be in principle to the idea of evaluation. 
Often, therefore, when administrative leaders authorize 
or sanction evaluation involving research, they do so in 


and operations such as audit, inventory, market analysis 
already have some meaning for a board of businessmen. 
\ familiar language may help to establish communication 
between the administrative leader and the research person 
or technical consultant. It may help too in breaking down 
such negative stereotypes of researchers as boys from the 

Recent investigations into the phenomenon of the ivory tower, long hairs, brain trusters, etc. When people 
authoritarian personality suggest that the only certain 


a mood of indulgence not of genuine involvement. 


can, through communication, identify and articulate a 
way to cope with people in authority who block honest genuinely and commonly felt need for 


improvement, 
ind effective evaluation is to introduce into the situation honesty i 


evaluation is virtually insured 


a community center learns about evaluation 


What problems does a local leader run into when he, along with 
his board and staff, tries to evaluate a part of his program which isn’t 
working well? And how can he go about solving these problems with 
the help of an outside consultant? Although the experience reported 
here took place in a community center, the principles and methods 


illustrated are applicable to nearly any type of local program. 


The case material which follows is a sequence of hypothetical letters between Gregory 
Hemple, executive secretary of the Columbia Community Center in Addison, Indiana, 
and Herbert Brubaker, program consultant in the national headquarters of Community 
Centers United. In this exchange of letters Hemple and his local board and staff face 
some of the tough problems in doing self-evaluation and, with Brubaker’s advice, 


learn: how to solve at least some of them. 


In order for readers to learn from Hemple’s experience, we sugyest the follow 
ing method for studying the case material. After reading each letter and its enclosure 
put yourself in the shoes of the recipient and think about what you would do and 
say in response. We have listed some questions after each letter which you may wish 
to use in thinking through what you would do. When you are clear in your own 
mind how you would reply, read the next letter and compare your ideas about what 
to do with what the recipient actually did. Remember he isn’t necessarily right in 
what he did. Your ideas may be better than his or they may not. 


This way of studying the case should provide experience in both the role of th 
local practitioner trying to learn about program evaluation while doing it and the role 


of the outsider who is called upon for help 


In a “Summary Comment” at the end of the articie we have listed the principles 


we see illustrated by the case 
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Dns Veneta ce ae 


held steady and in due course, after much heated di 
cussion, Dr. Hartshorne was officially named to the Ad 
visory Research Comrnittee. 

But the basic resistance to research persisted, It 
reappeared dramatically at a special conference of na 
tional staff executives called to consider a report of pro 
posals for the new and enlarged research program. Much 
devoted labor had gone into de signing a series ¢ f research 
projects. In the main, they were focused on studies of 
leadership, leader hip of small groups and leader hip in 
relation to its actual effects on the behavior, attitude 
values, knowledge and abilities of the members. The 
methods and techniques proposed took advantage of the 
latest advance in the human sciences 

One by one, each of the major project proposals 
wa ummarized and f «plained In his opening remarks, 
the research director had stressed the point that research 
provides an organization with systematic, di ciplined 
and responsible self-criticism, He had also paid high 
tribute to the impressive ac hievements of the organiza 
tion in serving the nation’s youth through many year 
Suddenly, and without any warning, while the research 
director was outlining one of the most important pro- 
posals, the chief executive rose to his feet, smote his 
cane on the table and punctuated the presentation with 
this accusation—“Gentlemen, | brand such talk sheer 
disloyalty! 

It was actually deep loyalty, loyalty to youth, loyalty 
to profession and loyalty to science that fortified the 
research staff to continue its work under the impact of 
such fierce and fanatical fury 


By exercising unbounded self-restraint and diplo 
macy the research staff managed to salvage much of it 
projected program and to carry it to a successful com 
pletion. World War II, the gradual loss of key member 
of the research staff to military service, the death of the 
chief executive and the appointment of a successor who 
had even | respect for research than his predecessor 
combined, in due course, to reduce the research program 


to a minor operation, 


Its a Local Problem Too 


If this kind of attitude toward honest evaluation is 
found in the headquarters of large national organiza 
tions, what attitudes toward evaluation operate at the 
local level, and more particularly in the supervision of 
leaders directly related to actual groups? 


A large number of young adults and adults are 
found in leadership positions every summer in organ 
ized camps. Some of these camps are relatively autono 
mous, even when they are affiliated with local units of 
national organizations. Some are independent of any 
national organization. The important point here is that 
leaders in camps, like leaders in thousands of other local 
organizations, face the need to evaluate their operation 
every year. An analysis of evaluation experiences in 
camps may give us some clues as to how ten ion, con 
flict and outright dishonesty can be reduced or elimi 
nated in attempts at objective appraisal of local pro 


grains. 


Four kinds of attitudes toward camping complic ate 
evaluation. There is a wide spread tendency to take the 


value of camping for granted. The popularity of the 
organized camp is accepted as an adequate measure of 
its success. This attitude is often protected by the rela- 
tive immunity of many camps, because of their location, 
from public scrutiny. Closely related is the view that the 
most important outcomes in a camping experience are 
spiritual and intangible amd that they, therefore, defy 
evaluation. Any attempt to measure results is regarded 
4s a kind ol ac ademi« impr riinence verging on sat rilege. 
A third attitude may partially account for this view. It 
is the rather naive assumption that appropriate and ade- 
quate tec hniques for appraisal are unavailable. Nothing 
could be further off-center. And even some who are 
familiar with the fact that highly developed techniques 
for evaluation are readily at hand-—and this constitutes 
the fourth attitude—will argue that evaluation is some 
thing for the “expert,” that it is beyond the competence 
of the average camp director and staff to make an ade- 
quate impartial appraisal of their program. 


Lying back of these attitudes and the resistances to 
self-objective evaluation they release in camps, in agen- 
cies and in adult education programs generally, is an 
educational tradition. This tradition establishes evalua- 
tion as the prerogative, even the monopoly, of those in 
educational authority. Evaluation frequently is viewed as 
a tool of administration, not of education. Accordingly, 
evaluation has come to be something to be feared by its 
subjects. Actually, careful thought shows that evaluation 
is one of four indispensable steps in any process incor- 
porating educational development. These steps are: (1) 
determining objectives; (2) formulating a plan of ac- 
tion; (3) carrying out the plan, and (4) evaluating the 
results. All persons and interests involved in the educa- 
tional process should be involved as partners in evalu- 
ation as in each of the other steps. Leaders, whether they 
be administrative, supervisory or those directly related 
to persons in groups, have no justifiable monopoly on 
evaluation. 

In other words, adult attitudes toward evaluation 
today are the product of patterns of education yesterday 
in which pupils in school, students in colleges and uni- 
versities, and members in many different voluntary or- 
ganizations have been barred from any genuine sharing 
in evaluation. Evaluation has been something done to 
them not with them. Except in rare instances, evaluation 
has not been a partnership between adults in authority 
and the members of ( lassrooms, clubs, groups and teams. 
Among the consequences flowing from this unfortunate 
practice is a pervasive resistance to evaluation and a 
basic conflict between evaluation as inquiry into the ef- 
fectiveness of program and performance, on the one 
hand, and evaluation as justification or punishment, on 
the other. 


Fostering Honest Evaluation 


If evaluation—self-objective, honest evaluation—is 
to be woven into the fabric of programs of adult educa- 
tion and adult action, it follows that some realistic strat- 
egy will have to be devised to identify areas and degrees 
of readiness and resistance to evaluation in organizations. 
It follows further that deliberate experimentation will 
have to be attempted to discover the best ways of ad- 


adult leadership 
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vaneing evaluation against suspicion and distrust. An a person of still greater 
evaluation of ways of introducing and initiating: evalu- 
ation is clearly called for. 


status and prestige, someone 
higher up on the totem pole, who supports and sanctions 
it. If an agency board, an administrator or a group carry- 
ing responsibility for a program frankly admit that they 
don’t know the answers to what everyone recognizes as 
a really difficult problem, they will help create a readi- 
ness for research throughout their organization, Some- 
times this latent hospitality to evaluation can be developed 
if research-minded leaders deliberately talk the language 
of those in control. For example, terms for research tools 


Only a few general hints about strategy are possible 
here. Evaluation, like any other activity, can only be 
started and carried through successfully, where readiness 
for it can be cultivated. Too often evaluation fails because 
it is initiated from outside, psychologically speaking. 
Often the first efforts are much too much on the grand 
scale. Often its technical requirements appear to demand 
a sophistication which frightens and immobilizes admin 
istrators and leaders alike, however hospitable they ac 
tually may be in principle to the idea ol evaluation. 
Often, therefore, when administrative leaders authorize 
or sanction evaluation involving research, they do so in 


and operations such as audit, inventory, market analysis 
already have some meaning for a board of businessmen. 
\ familiar language may help to establish communication 
between the administrative leader and the research person 
or technical consultant. It may help too in breaking down 
such negative stereotypes of researchers as boys from the 
ivory tower, long hairs, brain trusters, etc. When people 


can, through communication, identify and articulate a 
way to cope with people in authority who block honest genuinely and 


and effective evaluation is to introduce into the situation 


a mood of indulgence not of genuine involvement. 
Recent investigations into the phenomenren of the 
authoritarian personality .suggest that the only certain 


commonly felt need for improvement, 
honesty in evaluation is virtually insured 


a communit y center learns about evaluation 


What problems does a local leader run into when he, along with 
his board and staff, tries to evaluate a part of his program which isn’t 
working well? And how can he go about solving these problems with 
the help of an outside consultant? Although the experience reported 
here took place in a community center, the principles and methods 


illustrated are applicable to nearly any type of local program. 


The case material which follows is a sequence of hypothetical letters between Gregory 
Hemple, executive secretary of the Columbia Community Center in Addison Indiana, 
and Herbert Brubaker, program consultant in the national headquarters of Community 
Centers United. In this exchange of letters Hemple and his local board and staff face 
some of the tough problems in doing self-evaluation and, with Brubaker’s advice, 


learn how to solve at least some of them. 


In order for readers to learn from Hemple’s experience, we suggest the follow 
ing method for studying the case material, After reading each letter and its enclosure, 
put yourself in the shoes of the recipient and think about what you would do and 
say in response, We have listed some questions after each letter which you may wish 
to use in thinking through what you would do. When you are clear in your own 
mind how you would reply, read the next letter and compare your ideas about what 
to do with what the recipient actually did. Remember he isn’t necessarily right in 
what he did. Your ideas may be better than his or they may not. 


This way of studying the case should provide experience in both the role of the 
local prac titioner trying to learn about program evaluation while doing it and the role 


of the outsider who is called upon for help. 


In a “Summary Comment” at the end of the article we have listed the pring iples 
we see illustrated by the case 
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COLUMBIA CUMMUNITY CENTER 


@ 1226 BAKER STREET, ADDISON 16, INDIANA 


GREGORY HEMPLE 
EXECUTIVE SECRETARY Affiliated with Community Centers United 


December 4, 1952 ENCLOSURES 


vommunity Centers United ‘ ! 
526 Madison Street Average Daily Attendance /( 
. 7AQG 92 oiled Pind } 
New York 12, New York 18 °49 °50 °51 752 
Children 3 li 2 RB SS 


Teens 27 30 28 37 4I HEF 


' , , ta PRC 
Your visit to the Center four years ago and our several con- Young Adults 29 20 27 21 18 
| 


versations at the annual conferences have acquainted you Older Adults .. 23. 8 > 77 

with the general situation here at CCC. We've run into some Mr. 
real problems recently in evaluating our program for the Exe 
18-25 year old group, and the members of the board and I Average Per Meeting Attendance Col 
would appreciate very much the kind of help we know you can of Young Adults, 1952 122 
wit , ) 
give u Center social night Deh couple Ss ac 


We've spent the last three board meetings evaluating our club—-34, arts and crafts —6, discus 


7. ‘ . . > 
overall program. Although our growth so far as services to sion club—7, music night—6, game ; 
children, adolet nts, and older adi s has been satisfac- . - : . . x It 
iildren, ale é , 1 olde ilts has been satisfa night—5, bridge class—(discontin- : It 
tory, during the last two years the 18-25 year old group d july °52 ms ht li 4 you 
+ ' “) , Sing l (dis 
hasn't used the Center nearly as much as previously. I'm _ ns : — : ] 


enclosing a statistical summary of the information we have continued May °52)—7, inter-elub 


available on this problem council —3. 


el ah 
Ps 
i) 
— 


We've studied these statistics from several points of view 
So far as the 18-25 year olds are concerned the board has Survey of Facilities 
oncluded we must do at least these two things: 


First: Substantially expand or improve our building facil- 


ities You may remember that we don't now have any space Games x x 
for dan s. Neither do we have adequate game facilities. Arts, crafts x x 
We also need a swimming pool or bowling alleys or some- Club rooms x 


thing like that I arranged for the board to visit other 


Swimming 
Community Centers in Addison and they were impressed with 


~ ib > 
Bowling x 
the use which the age group we were worried about made of 


dancing parlors, swimming pools, bowling alleys, et 


Dancing x x 


ond: Add at least two new staff members who will spend 
of their time working with this 18-25 group. During 
the past two years we haven't been able to staff ade- 
juately the program activities that have been underway, 
ind have had to curtail some activities, even though there if you were Mr. Brubaker and 
have been fewer people involved in them than we'd ha 
previously. 


received this letter— 


What additional data would 


Can you suggest any other possible solutions to our prob- you want to have before giving 
lem? If not, can you advise us on ways to carry out these definite advice? 


two prograg 


Where, if at all, would 
The board and I realize the information we are sending you question Hemple’s conclusions ” 
is limited, but we really need your help. If there is any- 
thing else you would like to know about what we are trying What next steps would you sug 
to do for the 18-25 group, or the evidence we have tried to gest? 
collect in connection with our recent efforts at evaluation, 
please ask for it 


Sincerely, 
Pepery Hao 
a 


Gregory Hemple 
Executive Secretary 


6 adult leadership 
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Community Centers United 


HERBERT BRUBAKER 
PROGRAM CONSULTANT 


ENCLOSURE 


Sample Questions 


1. What specific activities young 


December 10, 195% adults ask for are you unable to 
Mr. Gregory Hemple 
Executive Secretary 
Columbia Community Center 
199¢ 


1226 Baker Street 
Addison 16, Indiana 


prov ide f 


2. What do these young people 
like especially about the Center? 
What do they dislike? 


Dear Mr. Hemple: 


}. What reasons do the young peo 


It was good to hear you again. I'll be happy to help ple who have dropped out give for 


you as much as I can. t 


having done so 
I inferred from your letter that your board continues to 
take an active interest 1 the Center. I realize how much 
that must please you. statistical material you sent me 
is highly significant. As you pointed out, it clearly indi- 
cates the need to evaluate carefully what you have been 
doing for the 18-25 year old group. 


1. In which of your program ac 
tivities for young aduits do you 
feel the greatest need for addi 


, 


tional staff services 


PTTTTITTTIIT IIL TLE 


To help you get a clearer picture, I have a feeling that in 
addition to finding out how often the 18-25'ers use the Cen- 
ter, you and your board may want to try to find out more 

about the way they see the problem. I am enclosing a list If you were Mr. Hempie and 
of questions that may be helpful. received Brubaker’s reply— 


: How would you feel about 


I realize that getting dependable answers to questions like Mi Brubaker’ ti 83 
these may strike you as a formidable task. There'd be a ss ee 
good many advantages to involving the members of the board, that you will answer all of 
and other interested people in digging up the evidence. his questions? Why? 
Adults frequently enjoy the kind of association with young 
people that is involved in interviews Do you think he has given 
enough help in how to find 
I'll look forward to hearing from you again. You might send 
me not only the statistical summaries of the data bearing on 
the four questions I've posed but also the inferences you What dimensions of your 
and your board draw regarding program improvement. 


answers to his questions? 


problem not considered in 
your original recommenda 


Cordially, tions do his que tions sug: 


bet Beubeber 


Herbert Brubaker 


Program Consultant 


a sane amr eae amsomaes: 
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COLUMBIA COMMUNITY CENTER 


@ 1226 BAKER STREET, ADDISON 16, INDIANA 


GREGORY HEMPLE 
EXECUTIVE SECRETARY 


January 17, i953 


Mr. Herbert Brubaker 
‘rogram Consultant 
Community Centers United 
526 Madison Street 


New York 12, New York 


— 


Dear Mr Brubaker 


You will, I believe, be pleased to hear how much we've 
learned about our problems since receiving your 


Your very first question showed us the need for a systematic 
way of keeping track of requests or comments on program and 
facilities and we've set up a tally sheet at our front desk 
to keep a record of such requests 


I enclose summaries of the data we've collected in answer to 


your questions The best result to date is that at least 
some of our board members accepted your suggestion that they 
take part in our fact-finding. Five agreed to give an 


evening each, to come early and stay late, so that they 
could talk with as many of our young adults as possible. 


We found that nearly every member of our Couples Club ranked 
it first Our Center Night socials are also very much 
liked, as the enclosed summaries show; but it takes a great 
deal of staff time to prepare for them. 


Frankly, we aren't able to answer your question about 
specific staff needs at this time. One thing which may be 
Significant came out of the last meeting of the Couples 
Club The Club, composed of young married and engaged 
couples, planned and conducted the whole program and also 
volunteered to take charge of all preparations for next 
month's Center Night party. If they follow through as we 
hope, we may be able to save staff time in this way. 


Your suggestions concerning our young-adult program have 
been so helpful that the board and I wonder if you could 
spend a few days at CCC to set up a comprehensive evaluation 
of our entire program? We have a small fund that we could 
dip into for this purpose 


Sincer ely, 


C 7, ys oA 

a A % 

7 4 a 7 sovefs a 
Gregory Hemple 
Executive Secretary 


Enclosures 


P.S We were surprised that none of the young people said 
much of anything about the building. Perhaps our building 
and facilities are not as impor tant as we thought at first: 
or it may be that we were unduly impressed by one or two 
comments because they were made so vigorously. We were not 
able to get in touch with drop outs 


Affiliated with Community Centers United 


ENCLOSURES 


Requests for Activities Not 
Provided (one month) 


Cooking class ) 


Foreign language l 
Dancing (social) 3 
Square dan ing ‘ 


Modern dancing 
Bowling 
Sports 


Ceramics 


el 


Sewing 


Total for month 2° 


Activities Liked Best 
Activity Choice 


Ist 2nd 3rd 


Couples Club 54 6 2 
Center Night 


Social is 5 
Arts and crafts 1 | ] 
Discussion club | 2 2 


Music night | 4 ] 


If you received this letter— 
What questions do the new 


data raise in your mind? 


Do Hemple’s interpretations 
of the data gathered so far 


seem reasonable to you? 


Where do you think Mr: 
Hemple and his board need 
to look for additional evi- 


dence ? 


adalt leadership 
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Community Centers United 


HERBERT BRUBAKER 
PROGRAM CONSULTANT 


January 23, 1953 


Mr. Gregory Hemple 
Executive Secretary 
Columbia Community Center 
226 Baker Street 

Addison 16, Indiana 


Dear Mr. Hemple: 


Your letter of January 17 was very interesting. Getting 
information directly from the young people should give you 
better answers to your questions and begin to involve them 
in the evaluation, too. And I'm delighted to hear that 
board members are interested in the evaluation of your 


The information you sent seems to suggest that these young 
people may want to assume more responsibility for their own 
activities. I wonder if we haven't enough evidence to 
regard these as leads that could well be examined further. 
I'm enclosing a copy of a simple interview form you may find 
useful. If you could obtain a representative sample, making 
a special effort to sample the drop-outs, I am sure you 
could obtain reliable information without interviewing all 
of the young adults registered in your programs. Of course, 
your evaluation will depend on the discriminating interpre- 
tation of the evidence you get. You might use the form in 
helping you find out how to get your 18-25'ers interested 
and involved in planning and putting over their own activi- 
ties and contributing to the overall program of the Center. 
Maybe a closer look at the business of getting your young 
people to participate actively will produce leads, not only 
about how you can make the best use of your limited facili- 
ties and staff, but about how you can help keep the young 
people interested in the Center and wanting to use it. 


I appreciate your invitation to come to Addison, but cannot 
work a visit with you into my schedule right now. I feel, 
too,that except where technical help or specialized services 
are needed, it is better in the long run for you, your- 
selves, to build into the ongoing program of your Center 


just the kind of realistic, useful evaluation you are doing. 


Cordially, 


Nile? Beubiher 


Herbert Brubaker 
Program Consultant 
HB: wf 
Enclosure 


april, 1953 


ENCLOSURE 


Sample Interview Form 
(Adapt to specific situations) 


Name 


Address 
Ave Sex 


Oce upation (or ss hool) 


Date of registration 
Activities 


Interests 


Outside organizations 


1. In what ways do you think the 
overall program and _ facilities 


could be improved? 


2. What would you be willing to 
do to help? 


3. In what particular program are 


you most interested? 


1. What suggestions do you have 
to improve this particular pro- 


gram ¢ 


> What would you he willing to 
do to help? 


If you were Mr. Hemple— 
In what ways would you now 
modify your original analysis 
of why young adult activity 


has fallen off, and why? 


In what ways would you 
see your program for young 
adults as needing changes 
which you didn’t see orig 


inally 7 


How would you feel about 
Mr. Brubaker’s refusal to 
visit Addison? About his 
warning to be discriminating 
in the interpretation of evi 
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COLUMBIA COMMUNITY CENTER 


@ 1226 BAKER STREET, ADDISON 16, INDIANA 


GREGORY HEMPLE 
EXECUTIVE SECRETARY Affiliated with Community Centers United 


Mr. Herbert Brubaker Fe 
Program Consultant 

Community Centers United 

526 Madison Street 

New York 12, New York 


bruary 15, 1953 


Much has happened since we received your last letter. As I 
wrote you in my report of January 17, several of the board 
members became quite interested in getting some first-hand 
information about our program, especially as they began to 
interview members of the Couples Club. What they learned 
during these interviews and discussed together at Board 
meetings afterwards apparently prepared us for your sugges- 
tion that we try to get some systematic information about 
the involvement of the 18-25 group in program planning. 
Consequently—and this took most of the first two weeks of 
February—a team of nine of us really went to work. There 
were six board members, the two staff members who work most 
tlosely with the 18-25 group, and me. We used the interview 
form that you sent, slightly modified, and actually inter- 
viewed one-fifth of all 18-25 year olds who had been active 
in our program in any way during the past 18 months. We 
arranged all of the names in alphabetical order and chose 
every fifth name. How is that for a sample? Of the young 
people still living in the neighborhood, we interviewed 

93% of our sample. 


We see a number of implications for program modification. 
We feel much safer about introducing innovations, too, 
because of the evidence we have to back us up. We are 
preparing a mimeographed report, which I will send as soon 
as it is ready. 


We've already taken these ste; 


1. We had a big meeting of the 18-25'ers After refresh- 
ments, we looked at that interesting film about the 
Madison program. Then three of us took about fifteen 


minutes to report what we found out from our interviews 

and raised the big problem of whether the young people 

wanted to participate actively in program planning They 

broke up into small groups to discuss the problez, then 

agreed we should have a program-planning committee in- 
luding both staff and group members 


2. We got the program committee set up—six members from 
the group, representing different ages and interests, in 
addition to the three staff members We've got a lot to 
learn about how to work together as a group but have 
already made some fine recommendations 

Both the staff and the members of the Board are so pleased 
with the results of the study of the 18-25 group that we are 
about to launch a similar evaluation of our services to 
other age groups. 

Sincerely, 


7? Z, tte 
Upregery Alef * 
Py nF 

Gregory Hemple 

Executive Secretary 
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SUMMARY COMMENT 


What principles about program eval- 
uation and about improving it does 
the learning experience of Mr. Hem- 
ple, his board and his staff illustrate? 
Vhere are probably others but these 
seem among the most important. 


1. Program recommendations based upon 
an evaluation will not fit the situation un 
less evidence about all important dimen- 
sions of the problem is gathered and con- 
sidered in making the evaluation. Mr. 
Hemple and his board at first had not 
gathered the reactions of the young adults 
themselves to the program. As this kind of 
evidence came in, their recommendations 
shifted from a central emphasis upon need 
ed buildings and equipment to an empha- 
sis upon improving the quality of partici 
pation by young adults in the program. 


2. As new evidence comes in, the shape 


of the problem changes. Evaluators need 
to be flexible about redefining the problem 
as they go along. New evidence also sug 
gests the need for further new evidence 
Information which Mr. Hemple’s grou; 
collected about the program for young 
adults showed them the further need fo: 
evidence about the other programs in the 
Center. All of the needs for evidence can 
not be determined by one big survey in 
advance. Evaluators have to do some eval 
uation in order to find what further evalu 
ation is needed. 


3. Leaders in a program cannot get all the 
evaluation data needed without including 
participants in the program as partners in 
the evaluation. Mr. Hemple and his board 
could not say what young adults felt about 
the program or how they would like to see 
it changed without asking them. Mr. 
Hemple and his board could not tell how 
far volunteers could take over “staff” re 
sponsibilities without giving them an oy 
portunity to assume leadership responsi 
bility. 


4. An outside expert may be very useful 
to a local group in their efforts to evaluate 
a program and to improve their evalua 
tions. But the outsider cannot do their 
thinking and learning for them. Mr. Bru 
baker seemed to realize this most of the 
time and the local group seemed to rise 
to his challenge to make their own deci 
sions. The expert can make suggestions 
about where and how to look for evidence 
and how to interpret it. The local group 
must decide which suggestions to try and 
what their interpretations of the evidence 
mean for improvements in their program 


adult leadership 
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@ Adult leaders who are enthusiastic about self- 
appraisal have made a good start toward improv- 
ing program evaluation, But they also need to 
take a hard-headed look ahead at the obstacles to 
a thorotgh evaluation of program and perform- 
ance. This article analyzes four of the most typical 
obstacles and suggests how to overcome them. 


N ADULT leader may accept fully the idea that 
4 honest and searching evaluation is an important 
key to a better program His colleagues may accept the 
idea, too. Even so, he will almost certainly run into 
difficulties when he tries to translate the idea into prac 
tice. What are some of the obstacles which the adult 
leader typically encounters as he tries to extend and im 
prove evaluation in his group or organization, and how 
can they be overcome? 

The crucial effects of an adult program are its ef 
fects on people. Adult progre-as are set up to produce 
changes in people—in their knowledge, their ways of 
thinking, their attitudes or their conduct. An organization 
can't be sure how much it is accomplishing until the 
effects of its program can be traced in the lives of in- 
dividuals, of groups, or of communities, 


PEOPLE ARE COMPLICATED 


Part of the difficulty in evaluation stems from the 
fact that dependable knowledge of people and of changes 
in people is hard to get. People are notoriously complex 
things to study as individuals. The complexities aren’t 
lessened when we try to study individuals in their asso 
ciation with other individuals. Of course, complete 
knowledge of the people a program affects isn’t necessary 
in order to evaluate its effectiveness. A program isn’t de 
signed to create people. It is planned to influence people 
in specific, limited areas of their lives. It is these specific 
effects which need to be understood in evaluating the 
program. But, even so, the specific changes a person 
makes in his way of thinking, a group works out in its 
procedures, or a community achieves in its organization 
to deal with a problem, aren’t easy to locate or describe. 

Suppose an organization does find out how people 
have changed during the time of their participation in 


’ 
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its program. It still doesn’t know all it needs to know in 
order to evaluate the program’s effectiveness. How are 
the changes connected, if at all, with the influence of the 
program’ People live and work under many influences. 
Any program is just one of these. , 

It is folly to deny that knowledge of people is hard 


to get. It would be even more foolish to conclude that 


such hnowledge shouldn't be sought in evaluating pro 


grams. 

Leaders and members do have some knowledges 
about the effects of their program on people. They know 
whether new people are attracted to join. They know what 
some of the people say about the program. They have 
knowledge based on observation of the program and the 
people in it. And they have the judgments of others with 
whom they dis uss the program as a check upon their 
own Opinions 

The realistic alternative to depending on the limited 
knowledge they already have to go on isn’t perfect and 
complete knowledge. It is, rather, more dependable 
knowledge at certain points, points where they feel they 
are depending too much on guesswork or where they 
realize the evidence isn’t complete or systematic enough. 

Moreover, leaders today can rely on the reasonable 
hope of being able to find more dependable methods of 
getting the information they need. Careful students in 
the various social sciences are continually working to 
develop more reliable and usable methods for locating 
and analyzing information about changes in people. Re 
fined and improved methods of using questionnaires are 
available, and more reliable interview, observation and 
testing methods have been developed in recent years. 
Some of these methods can be adapte d and used by adult 
leaders in improving their program evaluation. Others 
ean be brought in through the coope ration of social sei 
entists as consultants to an evaluation program 


EVALUATION IS CONFUSED WITH 
MEASUREMENT 


Another obstacle to evaluating the human effects of 
adult programs is a feeling that evaluation is the same 
as measurement. If effects can’t be measured, how is 
evaluation possible at all? Measurement is useful in 
evaluating our dealings with things. But what about 
people? It is easy to measure some of the characteristics 
of adult programs—-increases or decreases in member 
ship, the numbers of people attending meetings, the 
money spent on this item or that in the budget. But it 
is difficult, if not impossible at present, to measure others 

the degree to which the program embodies democratic 
ideals, the changes that take place in the morale, spirit 
and relationships of participants. 

What conclusions do these observations about meas 
urernent lead to? Leaders who identify evaluation with 
measurement may satisfy themselves with gathering and 
using only data about program effects which can be 
measured, inadequate as such data are to support all the 
judgments that must be made 

This seems a foolish conclusion when it is realized 
that it rules out of consideration some of the effects that 
are most important for checking how well program pur 

‘ 


poses are being met and for determining how they can 


he met more successfully 
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Another conclusion seems worth considering. It may 


be useful to know how people feel about a program, even 
though their feelings cannot be measured against estab- 
lished units of feeling in such a way that several inde- 
pendent measurers come out with the same numerical 
results. It may be useful to observe and record qualities 
of a atmosphere, the enthusiasm of the 
participants, etc., even though all of these observations 
can not be converted into quantities and treated statis- 
tically. Different observers may come out with different 
results. When they do, observations can be pooled, An 


alysis 


meeting —its 


of differing observations may lead to a more de 
pendable interpretation of what happened, even though 
no one Can say precisely how mus h each initial obse rva 


tion was in error. 


In brief a support 
to evaluation and as a check on observations and predic- 


desirable as measurement is as 


tions, knowledge about important aspects of a program 
or an organization can be improved even when these as 
pects can’t be measured. To collect data only about the 
measurable aspects of a program when more important 
data lie elsewhere seems to violate common sense rather 
than illustrate it. 


Evaluation is never the same thing as measurement 
available, eval- 
still have to make judgments about what the 


anyway. Even when measurements are 


uators 
measurements mean, in terms of changing the program 
or keeping it as it is. Measurements can support judg 
ments about stre ngths and weaknesses in a program. They 


are never substitutes for judgment. 


PEOPLE HAVE LEARNED TO 
DISLIKE EVALUATION 


Sometimes people are reluctant to spend more time 
and effort on program evaluation. because they have had 
distasteful experiences with evaluations in the past. What 
are some of the misuses of evaluation which turn people 


against it? 


The board of an organization orders an evaluation 


in response to some criticisnt. 


(The organization may 
. o~ . . 

have been rccused of dealing with subversive topi Ss in 

a discussion program, permitting loose morals in a re 


reation program, lowering educational standards in a 


program of evening classes, or, if publicly supported, of 
wasting the taxpayers’ money.) The board brings in out 
side experts to do an evaluation as an answer to these 
accusations, The leaders in the organization’s program, 
in effect ordered to do 
more work to produce evaluation data. They are sub 


already loaded with work, are 
jected to pying ar d prying (as they see it) by outsiders 
They are required to justify what they are doing. This 
extra time jis spent not in improving their planning and 
pt rformane c 


but in defending the program lo appease 


outside interests which they may see as hostile to their 


own purposes and standards 


Or the board (or someone else in authority) may 


use evaluation as a way to eliminate “inefficient” workers 


or program units or to justify retrenchment in the budget. 
More than one conscientious teacher or program leader 
has been evaluated out of a job. The board may conduct 


' an evaluation of a part of an organization's program in 


order to justify a decision to abolish it--a decision which 


has already been made before the evaluation. 
~ 


Sometimes people have gone through the experience 
of putting serious effort and extra time into self-examina- 
tion only to see it wasted when the evaluation report is 
filed away and forgotten by those in authority. They 
may have been required to spend extra time and labo- 
rious effort in determining something they already know 

that they have only half the budget they need to ac- 
complish their purposes, or that the characteristics of the 
neighborhood in which they operate have changed over 
the past twenty-five years. 

When people have had such experiences, it is hard 
for them not to see evaluation as potential punishment, 
as a personal threat to their status and reputation, or at 
best as a waste of precious time and effort. 

People who have had a bad experience with one 
evaluation are likely to resist the next one. Where they 
cannot block it completely, they are inclined to cover 
up as much as possible, rather than to open up frankly 
and honestly. The only antidote to such resistance is to 
remove personal threats from the process of evaluation 
and to emphasize its positive purpose as a way to im 
proved planning and performance in the organization. 
The only way to persuade people who have heen burned 
in the past that this evaluation is going to be different is 


to provide throughout the whole evaluation process for 


genuine participation by all people affected. This includes 
a share in planning how the evaluation is to be done, in 
determining what data need to be collected, and in in 
terpreting the results. Such participation is especially 
important where factors of public defense or unavoidable 
retrenchment, as well as program improvement, are part 
of the motivation for undertaking the evaluation. 


FUZZY GOALS HANDICAP EVALUATION 


It is impossible to determine how effective a pro 
gram is unless the intended effects of the program are 
clearly seen and formulated. We can’t judge how well we 
are doing unless we know what it is we are trying to do. 
Members or leaders of an organization may find it dif 
ficult to see what purpose improved evaluation will serve 
or indeed how it can be done at all because they are not 
clear on what their goals actually are. Until program 
goals are seen in terms of intended human effects which 
can be assessed by public scrutiny, evaluation will not 
make mute h sense, 

Actually, the best way to make sure that the goals of 
a program are meaningful and clear is to set out to eval- 
uate the program. One trouble with goals is that they 
tend to remain high-sounding words and pious wishes. 
We can’t know whether we are making progress toward 
them or not. To estimate progress, to evaluate, requires 
answers to two questions about program purposes, If we 
serve our purposes, what changes in people and things 
will result? How can we tell whether these changes are 
taking place or whether they are not? Without answers 
to these questions, the purposes are not fully clear. The 
process of working out answers to these questions is a 
direct aid to program improvement. It also provides a 
necessary basis for continued self-examination and eval- 
uation. 
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evaluating 
your program 


VALUATION is an essential part of the proe- 

ess of intelligent direction and control of 

human activities. As such, it cannot be 
avoided. We evaluate and are evaluated whether 
we will or no. 

Yet many people are afraid of evaluation, 
and it is not hard to see why. Traditionally, evalua- 
tion has often meant a process by which individuals 
are rewarded and punished by persons who exer- 
cise power over them, and this meaning is some- 
times still the prevailing one when the parent evalu- 
ates the child; the teacher, his students; the super- 
visor, those he supervises; and the military officer, 
his subordinates. 

But in the long march from authoritarian to 
democratic ways of life evaluation has come to 
have an educational rather than judicial purpose. 
We may evaluate not to reward or punish, but to 
help ourselves and others to set more adequate 
goals and to discover more effective methods of 
achieving them. It is this use of evaluation, applied 
to adult groups, that we shall discuss and illustrate 
in this tool kit. 

If evaluation is to serve as a means of 
improving our activities, we need to go be- 


yond the common conception that evaluation 
is merely finding out to what extent we are 
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achieving the results we want. Finding out, 
for example, that a group of persons learn- 
ing to type has only achieved an average 
speed of 50 words a minute instead of an 
expected 60 tells us that something is wrong. 
It does not tell us what is wrong and, there- 
fore, gives us no clues as to how to bring per- 
formance up to expectations or whether the 
expectations were unrealistic. 


SETTING accurate information about the extent to 
B which we are doing what we set out to do is an « 
ential first step in evaluation. It tells us whether im 
provement 1s needed, But if improvement is actually to 
occur we need to find out what is wrong, and to work out 
plans for remedying it. 
If this makes sense, 


quires a number of different operations. Here is a list 


that evaluation re 


of some that seem to be essential 


I. Stating the objectives of a group or organizational 
program in specific terms so that evidence of the 
degree to which objectives are being achieved can 


be obtained. 


~ 


ecuring evidence of the degree to which objec 


tives are be ing achieved. 


Securing facts about what is being done to achieve 


the obj clives. 


Developing ideas about what factors might be help 


ing and hindering the achievement of objectives 


. tool kit 
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5. Securing evidence tor and against these ideas. 
6. On the basis of the evidence obtained, revising 


ideas about what is helping and hindering the 


ichievement of objective s. 


a 


Developing and trying out methods of remedying 


weaknesses in the program. 


An evaluation program that omits any of these ste ps 
may do more harm than good. However, evaluation pro 
‘rams may vary in the thoroughne s with which each 
of these operations is carried out. The finding and in- 
terpretation of facts have to be done within limitations 
of time, money, the availability of research facilities and 
personnel, and the willingness of the persons involved 
to study and change existing habits. These limitations 
will vary widely from one organization to another. But 
whatever the limitations, even a little systematic evalua 
tion is better than none at all 


Who should evaluate? 


One of the things that makes some people shrink 
from the very idea of evaluation is, as we suggested earli 
er, the fact that evaluating is often something that a 
superior does to a subordinate. Much of this element of 
threat is removed if it is clear that the purpose of an 
evaluation is to improve the pe rformance of all the per 
sons involved in an undertaking. If this is the purpose 
then it is reasonable for everyone concerned to take an 
tive part in the evaluation process. This is important 
not only to reduce fears of evaluation, but also to in 
crease the sources of useful information and ideas, and 
to enable people to learn and change. This last point is 
particularly important. If an individual takes part in 
discovering the effects of an activity in which he has a 
part and then helps to work out plans for improving the 
activity, he is likely to 


. have confidence in the evaluation process 
understand what effects his own work has on the 
uccess of the activity 

eviginate or accept suggestions for improving his 
work 

_ be willing to make the changes or to learn to make 
the changes that seem desirable. 


What We Evaluate 


The desire to evaluate begins in some dissatisfac 


tion with the way we are carrying on our activities, the 
results we are achieving, or the goals we are trying to 
reach 

In the past attention was most often paid to how 
fully some tangible end-product was achieved, some 
product that could be measured in quantitative, imper 
sonal terms—achieving a membership or financial goal, 
for example, or learning specific facts and skills, or get 
ting some specific change made in the community. 

While such tangible results remain important, in 
recent years increasing attention has been given to the 
effects of our activities on the persons involved. We have 
also learned much about the ways in which methods of 
working together affect the people who take part as well 
as the tangible, bry rsonal outcomes achieved. 
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Tools and methods for studying changes in peopic 
and in their relationships that result from program ac- 
tivities are a recent development. For this reason we 
have chosen to focus attention on them in this Tool Kit. 


We have discussed three uses of evaluation—each 
in a different specific situation. The principles and meth 
ods illustrated, however, have a wide range of applica 
tion. kach of the three uses of evaluation is focused on 
the improvement of a different aspect of an organization’s 
program—-first, the organization as a whole; second, the 
small groups in an organization; and third, the individual 
in terms of what he is learning 


How can evaluation improve 
the functioning of an 
organization? 


Biers see how this question arose and was dealt with 
by the Women’s Welfare League of Suburbanville. 

The Welfare League became aware that things 
weren't going well when its president reported to the 
membership “if the present decline in membership con- 
tinues for another year, it will be financially impossible 
to carry on our program.” The organization was thor- 
oughly shocked. But there were the figures, a gradual 
but substantial loss over the past 15 months. Everyone 
was aware of a decline, but the size of it was unex pec ted. 
After some discussion it was decided to reactivate a 
dormant membership committee. But after a few weeks 
it became evident that a membership drive alone would 
not solve the probe ms lying back of the loss of members. 

The executive committee felt that only an examina 
tion of the organization would do. But where to begin? 
After a talk with an expert on organizational problems, 
the Executive Committee invited him to speak to a gen 
eral membership meeting. The points he made were 
these: 

Declining membership, or large membership ace «m 
panied by high turnover, are signs of organizational 
de« av. 

Adequate functioning, making for a stable, healthy 
organization requires: 


I Efficiency of operation through maximal individ- 
ual participation in group activities; 

2 Successful programs which meet the needs of the 
individuals involved; 

3 Achievement of goals without loss of group 
morale, 


These requirements provided clues to where the dif- 
ficulties might be found. The meeting set up an Evalua- 
tion Committee composed of rank-and-file members of 
the Welfare League, and instructed it to conduct a study 
of the organization to find out what was wrong. 

The Committee began with an examination. of all 
available information about the League’s membership. 
The League maintained up-to-date membership and par- 
ticipation records. From an examination of these for the 
past two years and from an examination of annual re- 
ports and committee records, the Evaluation Committee 
believed it could determine a number of relevant facts 
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about membership and participation trends. The fol 
lowing chart lists the facts they decided to find out and 
the types of evidence that were available to establish 
the facts: 


To Determine: 


The period or periods 
of greatest membership 


loss 


The shift in member- 
ship from a given date 
to the present 


Rate of meeting attend- 


Type of Data: 


Size of membership at 
three-month intervals 
for 2 years 


Percent turnover of 
membership over the 
whole period 


Average percent attend 


ance ance at meetings at 6- 
month intervals 


Proportion of active 
rate participants to total 
membership 


General participation 


Degree of concentration Average number of jobs 
of activity held by active members 


at 6-month intervals 


Intensity of group ac- 
tivity as a measure of Rating of committees 
morale, 


Here are some of the findings from the Committee's 
study: 


Size, Turnover, and Activity of Membership 
Every three-month period from January, 1951, to Janu 
ary, 1953, had registered a decline in membership. At the 
of this period membership had been 350, At the 
end it was down to 240 


beginning 


Similarly, the percentage of active I had de 
clined from 35% to 20% 

And the rate of turnover had increased. The average 
rate during 1951 was 5.3%; during 1952 it had risen to 9.2% 
The joining and resigning cycle was leaving the Welfare 
League with fewer veteran members. And these, the evidence 


showed, were the more active members. 


Attendance and Participation 
While attendance at meetings fell off sharply over the 
period, from an average of 135 in January, 1951, to an average 
of 66 in January, 1953, the concentration of activity (as 
measured by the number of jobs held by each active member) 
increased sharply. While active members averaged a little 
more than one job each in January, 1951, they were holding 
ibout three jobs each two years later. 
Intensity of Group Activity 
The combination of loss of membership and high turn 
over tended to Jower morale. Committee work, as measured 
on a five point scale from Very Active to Almost Inactive, 
fell off noticeably. 


The Evaluation Committee reported its findings to 

a general membership meeting. The data it had assembled 
on organizational functioning revealed: 

(1) Loss of membership 

(2) Increasing turnover 
(3) Decrease in individual activity 
(4) Increase of activity in only a few members 
(5) Decline in meéting attendance 


(6) Deterioration of committee functioning 
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Action 
It was realized that the crucial issue raised by the 
report was: What is cause and what is effect? Deriving 
its clues from the d&ta, the Committee recommended 
these further steps in the evaluation program 
(1) Interviewing all drop-outs for a given period 
to see if a pattern of causes emerges 
(2) Discussion of usefulness of present programs 
(3) Examination of leader-member relations to 
determine if paths to leadership are being choked off 
(4) Evaluation of recruitment techniques: is the 
interpretation of the organization resulting in frus 
tration and disappointment ? 
(5) Full discussion of the short-term and long range 
goals of the organization to ascertain if modification 
is required in the light of the reasons for resigna 
tion and the sentiments of the remaining members 


The lines were drawn for a full-scale self-study to 
revitalize the League. 


Mow can evaluation improve 
the functioning of small 
groups and committees? 


Mi any organizations provide opportunities for their 


members to work together in discussion groups or com- 
mittees. The operation of such small face-to-face froups 
frequently has a decisive bearing on whether an organi- 
zation achieves its learning and action goals. 

Realizing the importance of work in small groups, 
a city-wide World Affairs Council brought together the 
volunteer discussion leaders of its 15 neighborhood In 
ternational Relations Clubs to discuss with the Council’s 
newly appointed educational consultant the problems they 
were encountering. 

During the discussion a member of the Council's 
staff recorded on a blackboard statements of the prob 
lems that seemed most important to the leaders: 

“Discussion leadership is a demanding task insuf 
ficiently appreciated by those who are ready to criticize.” 

“Assigned reading material is only perfunctorily 
read by most members; and passive listening to speakers 
seems to interest them more than discussing.” 

“A core of me mibe rs in ea h exroup is congpe nial and 
cooperative; but a few members with widely differing 
political views try to monopolize the discussion.” 

The first of these statements was so obviously de 
fensive that the Council’s educational consultant who was 
present at the meeting felt that the group needed to de 
velop a commitment to some common goals of group 
leadership. He suggested that they try to deve lop a com 
mon understanding of the nature and functioning of 
small groups that would help them in diagnosing the dif- 
ficulties they faced. This proposal was accepted, and the 
consultant prepared for group discussion the following 
propositions: 

I. A group can exert decisive influence on individ 
ideals, 


exceeding the influence of an inspiring or dominat 


ual members’ ide as, feelings. and actions, 


ing leader. 
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2. The group’s influence is determined by such fac- 


tors as its degree of attractiveness, unity, self-direc 


tion, and effectivenc and by its members’ needs 
for acceptance, rec ognition, new experiences, and 
sense of be longing to that 


3. A 


ideas, acquire new values, 


group. 


member's readiness and ability to learn new 
and participate effectively 
in group activilies grows as he senses the group's 
readiness and ability to serve his needs and use his 


contributions. 

4. An atmosphere of warm fellowship fosters group 
unity, attractiveness, sel{-direction, and effectiveness. 
5. Group leadership exists when one or more per- 
sons are recognized by group members as best able 
to serve their common needs at that time; thus, 
leadership is a function which all members can 
rather 


share according to their interest and ability 


than an exceptional combination of personal qual 


ities. 
End-of-Meeting 
I. Were you interested in Very 
this meeting ? much 
2. Did you feel that the group 
P , : Very 
was interested in this 
9 much 
meeting ! 
3. Did you learn any new Certainly 


did 


facts or getany new ideas ? 


4. Did 


your previous opinions as 


you change any of ’ 
‘ B' : ; Certainly 


did 
a result of this meeting ? 
5. Were your previous opin 
Very 
ions confirmed or strength 
° much 
ened ? 
6. Do you think the group It 


accomplished anything as certainly 


a result of this meeting? did 
7. Was there enough prepa Mor 
than 
ration for the meeting ? 
€ needed 
&. Was there enough oppor loo 
tunity for discussion ? much 
9, Would the meeting have 


Certainl 
heen better if some parts : me 


had been left out? ots 
10. Did you find the social 

atmo phere of the meet Very 

ing congenial and enjoy much 


able? 


Il. Do you have suggestions (about techniques, 
side of page if necessary ) 


6. The circular process of cooperative goal setting, 
planning, action, and evaluation of methods of work, 
achievement, and goals propels a group; and peri- 
odic assessment of its sub-goals, immediate plans, 
and activities helps to navigate the group. 

7. Effective group evaluation flows from an aware- 
ness of a problem situation and leads to increased 
understandings and skills of the members, improved 
morale and productivity of the group, and eventual 
adjustment of, or to, the problem situation. 


After talking over these ideas, the discussion leaders 


decided to collect information about what their group 


members liked and disliked about the meetings of their 
International Relations Clubs. 


They felt that this information, if reported to their 


groups and discussed, would give them ideas about what 


aspects of their meetings were most in need of improve- 


ment. To collect these data the consultant and the group 
worked out the following form: 


Evaluation Form 


(Juite 


a 


Quite 


Probably 


bit 


bit 


did 


Probably 


(Juite 


probably 


bit 


did 
All 


that was 
needed 


All 


that was 
needed 


Maybe 


(uite 


materials, etc.) for improving future meetings? (Use other 


© 6 RO ewe re See me cee cee 


tool kit 


Some but Very 


not much little 
Some but Very 
not much little 
Maybe rat at 
all 
Not at 
Maybe ony 
all 
Some but Very 
not much ._; little 
I doubt It 
if it did 
did not 


Should 


have been 


Should 
have been 


more much more 


Should 
have been 
mue h more 


Should 
have been 
more 


Probably Definitely 


Very 
little 


Some but 


not much 


fort emma = 


er mt 
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In discussing this evaluation form the consultant 
pointed out that its value depends on the use made Content Report* 


of the information it provides; that if used as a start- 7 


Instructions: The group's recorder or se-retury fills 


ing-point for real group self-evaluation, it can lead to out this form during the meeting. He may report | 
important changes in the operation of the group, the back to the group at points during the meeting or 


at the close of the meeting : 


eee) 


relations among group members, and the amount of 

learning and growth that members experience. Group 
iie went on to explain how information about Recorder 

what group members think and feel about a meeting Date 

often changes each person's interpretation of what is 

actually taking place in the group. “Let’s suppose,” Points Made Solutions, Agree- 


he suggested, “that member A of one of the Inter- Major Prob- Major in ments, Decisions, 
. lem Area Issues Recommenda- 


Discussion - 
tions 


national Relations Clubs had always enjoyed the op- 
portunity to chat with his special cronies when coffee 
was served at the end of each meeting. This member 
might respond enthusiastically to question 10 about 
the social atmosphere of the meeting. Suppose, fur- 
ther, that many of the group members felt that the 
social atmosphere was unpleasant because A’s little 
friendship clique seemed to have a great deal in com- 


mon that the others didn’t get in on. The evaluation Six Point Reaction Check 


data reported to the group would reveal this wide Directions: Each group member fills one \i} these 


spread dissatisfaction. Member A would no doubt be check-sheets out, At six points during the meeting 
astonished, but he would begin to have a different (determined by observer, leader, or group as a 
picture of the social atmosphere because his interpre whole), each member checks in the appropriate 


column opposite questions A and Ik, The change 
and flow of interest and understanding can be sum 
marized and discussed afterward 


tation of what was actually going on would be based 


on knowledge of all the members’ feelings, not just 

on his own feelings and those of his cronies.” 

eee p ; _* A. At this moment how interested or personally involved 

This simple illustration indicated to the group , ; + sekenper se 
: are you in the subject under consideration ? 

how evaluation data helps to create a common picture : be 

of the situation in the group: no matter what each 1); 2; 8/| 4| &| 6 

individual’s private picture of the group is, it will be 

changed in some respect in the direction of a picture 1. Antagonistic 


that all members share. As a result, each member will 
2. Annoyed 


be more likely to act and react in the group situation \ 
in the light of knowledge about how the other mem . 

© : ce eae . %. Bored 
bers understand it and feel about it. This shattering of > 

? 3 : : ’ 1. No feelings one way or 

private illusions about what the group situation and anather 
one’s own role in it are, as perceived by the other 
members, is the beginning of insights that can lead 5. Interested 
to change and growth. 

: ; - : ne 6. Challenged 

During discussion the following additional points s 

came out. One of the values of “feeding back” evalu- B. How clearly do you understand what is being presented 
ation data to the group is that it transforms the dif or discussed at this moment? : 


ferences in the perceptions and attitudes of the mem 

bers from hidden sources of misunderstanding and 

conflict into publicly visible problems. If members 1. Unintelligible 
differ about the pleasantness of the social atmosphere 

(to use this example once more), the problem becomes 2. Vague and obscure 
one of diagnosing the causes of dissatisfaction and 
trying to create situations in which the whole group 3. Not altogether clear 
can share the satisfying social climate that had de 


4 ‘ 4. Generally understandable 
veloped among member A and his friends. s , 


Thus, the feed-back of data from post meeting 5. Good Grasp 
questionnaires can be used to identify problems the 
group faces. Usually more facts are required to help 6. Extremely clear 
the group diagnose a problem. The next step after 
that is planning and trying out whatever action the 


oint Reaction 


solution of a problem seems to require. *This Content Report and the Six | 
Check that follows are reproduced I 
the Center for Improving Group Procedures, Teact 


a number of other devices that have been found useful. ers College. Columbia University, New York City 


° . P iv courtesy al 
In subsequent meetings the group experimented with 


Here are examples of a few. lhe Center welcomes ine 
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A group me mber may use the following form to keep 
track of the number ol times 


flow of discussion 


members speak and of the 


Participation Record 


Instruction kach time the leader or another mem 


j / 


her speaks to the group as a whole, make a mark 
in the right hand column opposite the speaker s 
ymbol. Rach time the leader or another m ember 
peaks to an individual put the 


noken to in the left-hand column opposite the 


ymbol of the persor 


her yimbol 


Speaks to Member Speaks to Entire 
or Leader Group 


Iaader (L) 
Joe (A) 
Mary (BB) 
Helen (C) 
Steve (D) 
Ron (FB) 


The following references to previous issues of 
ADULT LEADERSHIP containing tools for securing data 
about some other aspects of group operation may be 
useful: 

]. the extent to which leader hip fisnctions are con 

centrated in the designated leader or shared by many 

grouyy members (ADULT LEADERSHIP, Vol. I, 

No. 2. “The Tool Kit Sharing the Leadership 

| oad pp. | b-20) : 

ae the degree to which members fill needed roles 
relating to the group's tasks and to group building 
and maintenance needs (ADULT LEADERSHIP, 
Vol. I, No. 8 “The Tool Kit 


90 


Rok ‘ pp. 17 a) 5 


Training in Member 


3. the degree to which the group is making use of 
the interests and skills of its members in planning 
and carrying out its activities (ADULT LEADER. 
SHIP, Vol. I, No. 4. “The Tool Kit—Working To- 


wards Goals,” pp 13-20. ) 


OL, Smal 


” 


“Should I wear heels, mother? 


/ 


1 upen the door to all evidence, pleasant and unpleasant} 


. tool kit... 


Mow can evaluation help 
adults find out what 
they are learning? 


We have dealt briefly with the evaluation of organizational 
and small group functioning, and come finally to a ques- 
tion of equally great importance—what the individuals 
taking part are learning and becoming in voluntary adalt 
groups. 

The following discussion of standards and methods of 
evaluation of their own learning by adult students is adapt- 
ed from a memorandum on evaluation methods prepared 
by Eduard C. Lindeman for the American Labor Education 
Service. Dr. Lindeman has recently been engaged in ex- 
perimental evaluation of a program of international edu- 
cation for American trade unionists sponsored by the ALES. 


“ AN) THING which exists, exists in some quantity 
and is hence susceptible to measurement.” So runs the 
scientist's maxim. Educators on the whole agree with this 
dictum and have hence devoted a great deal of time and 
energy to the development of tests, examinations and a 
Vast array of other methods for evaluating the conse- 
quences of their work. Very few of these devices are 
applicable to adult education. 

Why is this so? Why is it not reasonable to regard 
adult education as an extension of all previous education? 
After all, learning is learning, no matter when or where it 
takes place. Failure to understand the inner meaning of 
this question, and hence inability to find a satisfying 
answer, is the chief factor which accounts for so many 
false starts and so many disappointing ventures in adult 
education. Adult education is unlike conventional educa- 
tion in this important respect: it is wholly lacking in 
coercive or compulsive elements. Adult education is an 
act of free will, and from this important fact many other 
distinctions naturally follow. A mediocre teacher, using 
inappropriate teaching methods, may go on teaching for 
years without being detected, so long as he is protected 
by a compulsory system of attendance. Not so in adult 
education. The teacher of adults will have pupils only if 
he meets their current needs and is able to interest them 
ufficiently to evoke the will to learn. 

When the above distinction is clearly understood, all 
thinking and planning about adult education falls into an 
orderly and logical pattern. One sees at once, for example, 
that ordinary tests and examinations will not suffice to 
determine success and failure in adult education. Adult 
students cannot be compelled to take examinations. Nor 
would examinations constitute a reliable index of success 
or failure. What precisely is it we want to know about 
the adult learner and his experience as a student? 

Experiments conducted by the ALES during the past 
year in connection with the trade union international 
project (by means of short-term conferences, two-week 
seminars and the beginnings of at least one continuous 
resident school) have attempted to find an answer to this 
question. We have made numerous different approaches 
and have now accumulated enough experience to go for- 
ward with reliable methods of evaluation. 

The first and most important conclusion we have thus 


far reached may be stated thus: /n adult education, 


adult leadership 
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methods of evaluation must exemplify that same sense of 
freedom which characterizes the learning process itself. 
In other words, methods of evaluation should be internal, 
not imposed from without. Adult learners, in short, must 
also learn how to evaluate their own success or failure. 
What the adult learner needs to know is whether or not 
his learning is effecting any kind of change in him. Once 
having learned how to appraise change, he will want to 
know how to detect the direction in which he is moving. 
In the experiments thus far conducted, it turns out that 
adult trade union members involved in the study of inter- 
national affairs wish to know how this study has changed 
them in the following ways: 


1. Has it increased my usable fund of reliable infor 
mation? Curiously enough, it is not the mere accumu- 
lation of new facts which seemed to concern them 
most. The principal features of their concern ap- 
peared to be (1) the relationship between different 
bodies of fact, and (2) ways of distinguishing the 
various grades of reliability of information. 

2. Have I changed my vocabulary? Have I, in other 
words, learned how to make use of some new con- 
cepts? This question naturally leads to consideration 
of semantics and modern propaganda methods. 

3. Have I acquired any new skills? In one seminar 
the participants placed special emphasis upon the 
fact that they had learned how to interpret statistical 
tables and gray hs. In another, stress was placed upon 
improvement in the skill of using reference books. 
4. Have | learned how to make reliable generaliza 
tions? Such generalizations are the result of bringing 
disrelated facts into meaningful relationships. 

5. Have I learned how to sort out the moral ingredi 
ents in the various situations considered by this study 
group? Have I learned to think in terms of values? 
6. Have I altered any attitudes? An attitude is a 
predisposition to act in a certain way in response to 
a given stimulus. Basic attitudes do not, as a rule, 
change suddenly. But even in the short pe riod of two 
weeks it was discovered that important attitude 
changes were taking pla e. For example, one of the 
considerations dealt with the general question: “How 
do international relations affect my job?” When this 
question was clarified it became obvious that mem- 
bers of the seminar were in the process of changing 
their attitudes toward international matters from 
passivity to active concern. 


The above categories of evaluation are not intended 
to be inclusive. There are other items of information 
which adult learners would, no doubt, like to know about 
themselves. This list is, however, sufficiently inclusive for 
most purposes. But more important still, it has been found 
that adult learners will respond to this type of self-ex 
amination. These are evaluation terms which they unde 
stand and quickly learn how to use. 

Answers to the above six basic questions about th 
adult learner and his experience as a student may be se 
cured in at least three different ways, namely: 


1. The entire study group may engage in orderly 
dist usstOn, 7 he: meth: d of diss ussion whic h lends 
itself best to this type of inquiry is circular response 
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(Each of the members, seated in a circle, speaks in 
turn.) This method requires complete participation 
on the part of all members of the group. It eliminates 
argumentation and refutation and assumes that per- 
Sons who have shared a similar experience are 
capable of engaging in a cooperative evaluation of 
that experience. 

2. The group may be sub-divided into smaller units. 
In these units the method used may be informal, of 


the nature of well-ordered conversation. 


3. Each participant may be asked to engage in self 
evalnation by means of questionnaires. This method 
has been found to be the least fruitful but it is ou 
aim to experiment further in the hope that independ 
ent, written responses may reveal certain shades of 


meaning which do not emerge from group discussion, 


(hur second general assumption leads to another 
variety of evaluation. We assume that adult education is 
distinguished from formal education by the fact that the 
latter tends always towards standardization and formal 
ism, whereas the former, adult education, demands a high 
degree: of flexibility. Adult students are sensitive with 
respect to this question. This is as it should be because 
flexibility is an index to freedom. But what degree of 
flexibility is desirable? How many adult students and 
their teachers engage in a joint educational enterprise in 
which there is readiness to change directions without 
losing the sense of sequence and orderliness? One experi 
ment in which an attempt was made to follow this prin 
ciple involved the appointment of a “steering committee” 
composed of students and teachers. This committee met 
regularly throughout the seminar and reported inter 
mittently to the entire group. This was only in part sue 
cessful and it is our intention to experiment with othe: 
methods in the future. 

Our third general assumption from which still an 
other conception of evaluation emerges may be stated 
thus: In every genuine adult education enterprise it 
happens that the individuals who participate tend to 
become a true group. The prin ipal distinction to be made 
here, that is, between true groups and mechanical colle 
livities, pseudo-groups, is this: the former tend always in 
the direction of fellowship and friendship, whereas the 
latter tend always to create a semblance of unity through 
concealed coercions. The dynamics of true groups arise 
from that variety of unity which comes through the 
creative use of differences. What is the nature of the 
process he re involved? This question we belie ve, cannot 
be satisfactorily answered by an “outside” observer. Only 
participants will know how true groups come into exist 
ence and what dynamic principles they follow. Partici- 
pants who are examining themselves in the light of the six 
evaluation categories listed above will also want to know 
what is happe ning to them as members of this parti ular 
group. Are they sensitive to the way in which other 
respond to them? Do they know at what point they begin 
to feel a sense of really belonging to the group? Was 
there any moment when they felt they might be losing 
their individuality? Becoming subservient to the group? 
These are questions of an extremely subtle character and 
no simple methods of evaluation have thus far been in 
vented, 
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Finally, it should probably be said once more that all 
of our past and future experiments in evaluation are 
founded upon the assumption that adult learners must 
become participant observers. Only through the develop- 
ment of skills in participant observation will we be able 
to derive guidance with respect to what happens when 


adults assume the responsibility of continuing education. 


Research Methods in Social Relations, ed. by Marie Jahoda, 


Morton Deut cl and Stuart W Cook, N ,# Dryde n Pre ‘, 1951. 


? vol. $3.75 each. $6.00 set 


Part I pre nt a technical - ptlio basic processes in 


scientific social inquiry selected techniques for 


group proce e ¢ pecially Chapter 15, 


vation mall Face-to-Face Groups 


Training in Community Relations, by Ronald Lippitt. N.Y 
Harper & Bros, 1949. $3.50, 


4 record of recent successful experiments in scientific training 
of wnmunity | f : ‘ pecially Chapters 1] 13, “Mea ure 
ment of the Workshop Learning Situation, Aseesement of Work 
shop Effect and Factors Influencing the Effectivene and 

eae of the Workshop.” 


The Volunteer Work Camp: A Psychological Evaluation, 
by Henry W. Reicken. Cambridge Addison-Wesley Press, 1952 


vort of a study and evaluation of the domestic Work Camp 
Program of the Americar kriends Service Committee, and a 
consideration of the technique of psychological evaluation of social 
action programs. See especially Chapter 1, “Program Evaluation 


Pro edure 


; 
radiie 


’ 
tas For 


pts to answer 


pe XGRKAM evaluation requires evidence that can reveal 

how wel we are accomplishing what we have hoped 
for. It means holding up our doings and our sufferings, 
our activities and their effects, to the mirror of cold 
fact, Sx outing of things close to our hearts is never easy. 
Unlike the evidence sought in the anesthetic atmos 
phe re of the scientific laboratory, the evidence needed for 
program evaluation is taken in the midst of real-life 
situations which are saturated with the hopes and fears, 
prefe rences and pre judices of everyone involved, 


Readings in Group Work, ed. by Dorothea F. Sullivan. N.Y. 
Association Press, 1952. $4.50. 


Chapter 4, “Charting Group Progress,” discusses methods and 


presents forms for evaluating individual and group development. 
How to Work with Groups, by Audrey and Harleigh Trecker. 
N.Y.: Woman's Press, 1952. $3.00 

Chapter 14, “How to Check Up on Group Accomplishment,” 
gives a step-by-step presentation of group self-evaluation. 


“Identifying Educational Needs of Adults.” Circular No. 330. 
U.S. Office of Education. For sale by the Superintendent of Docu 
ments, U.S. Government Printing Office, Washington 25, D. C. 35c. 


Report of a study of 37 procedures commonly used by adminis 
trators of public-school and community college adult education 
programs in identifying needs and interests of adults, and an 


evaluation of these procedures 


“Handbook for Teachers of Adults,” California State Depart 
ment of Education, Bureau of Textbooks and Publications, Sacra 
mento 14, Calif. le. 


See annotation on page 31, this issue. 


“Teachers Prepare for Discussion Group Leadership.” 
Bureau of Publications, Teachers College, Columbia University, 
’ p 


New York 27, N.Y. 60c. 


See annotation on page 31, this issue. 


The following short readings, reprints and pamphlets on evalu 
ation are available from the Adult Education Association of the 
U.S.A., 1201 Sixteenth St., N. W. Washington 6, D. ¢ 


“Program Evaluation in Adult Education.” 50: 
“Portfolio of Teaching Techniques.” 75c. 

“My Group and I.” (Nine articles on how members can bring 
about improvement in their local teachers’ associations.) $1.00 
“Feedback and Group Self-Evaluation,” Journal of Social 
Issues, Spring, 1948. $1.00. 
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Since program evaluation means seeking evidence 
about the success or failure of our own hard work, 
we are tempted to collect evidence more to justify 
than to find out what we are doing. We are tempted to 
persuade ourselves and others that our purposes are the 
right ones and that our program serves these purposes 
successfully. If we yield to this temptation, the effect is 
to entrench ourselves in present practices, and blind 
ourselves to real opportunities for improvement, In- 


sights about how and why we should improve our pro- 


adult leadership 
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gram, our goals, or the way we think and work as indi- 
viduals and as a froup do not come to light. 


The alternative to evaluation for justification is 
evaluation in a genuine spirit of inquiry. When we set 
out to inquire, we already have doubts about how well 
we are doing. We want evidence that will tell us what 
needs to be changed if the problems and difliculties 
we sense are to be dealt with more adequately, When 
we approach evaluation in a spirit of inquiry, not of 
self-justification, we realize that hiding the unpleasant 
facts, or emphasizing the evidence that makes us look 
good, fools ourselves as well as others. We realize that 
problems can be solved only when all the relevait 
evidence, pleasant and unpleasant, enters into our think. 
ing and planning. 

We are not likely to banish self-justification and 
achieve a spirit of inquiry overnight. The forces that 
support the former in all of us are too powerful for easy 
elimination. As long as an organization feels that it is 
surrounded by hostility or indifference, it will be tempted 
to use evaluation as a device for defending or selling its 
present program. And as long as an individual feels 
that others in his organization will use evidence of 
limitations in his performance against him rather than 
as a basis for planning needed learning and improve- 
ment, he will avoid making such evidence public. A 
complete shift from an attitude of self-justification to 
one of inquiry means, in large part, a shift from a 
pattern of rivalry to one of cooperation in both the 
internal and external relations of an organization. 

Sut meanwhile, how can we make sure that the 
evidence we collect is appropriate for inquiry rather 
than self-justification? What questions do we need to 
ask about evidence when we collect it and when we use 
it for interpretation ? 


To be genuinely useful for evaluation, evidence 
must be relevant to what the group wants to find out, 
This requires clarity about objectives. Unless the group 
knows what it is aiming at, it will have no standard by 
which to judge relevance or irrelevance. Suppose an 
objective of a group is to bring together more Negroes 
and whites to discuss and solve community problems 
than has been customary in the community. Data about 
overall increases in participation is not, in itself, relevant. 
It may be that the increase in participation means only 
that more white people are coming to the meetings. 
Conceivably, too, the increase in this particular pro- 
gram, may have merely drained off people who were al 
ready meeting in other. non-segregated groups. To get 
evidence that is relevant to the stated objective, the 
group would have to get facts about the numbers of 
Negroes and whites who have normally met to discuss 
common problems, and further data to show what shifts 
have occurred in the typical pattern of participation as 


a consequence of its program. 


\ group cannot make good judgments about the 


importance of evidence without. again, being clear about 
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its objectives. But, in addition, it must be able to put 
differing weights on different objectives to determine 
importance as well as relevance. A discussion program, 
for example, may have the purpose of entertaining its 
participants as well as the purpose of changing their 
attitudes and information in some way. The group re 
gards the latter objective as much more important than 
the former. Therefore, data about changes in the atti 
tudes and information of the participants over a period 
of time are more important evidence for this group than 
data about how much participants enjoy the meetings. 


Sometimes different pieces of evidence are not 
strictly comparable with one another, Yet we are tempted 
to add up the different pieces to get what we call “the 
total picture.” Suppose, for example that a group gathers 
reachions to its program from some participants by a 
mailed questionnaire and from others during a small 
group discussion, The data from the two 
not comparable, and cannot rightly be combined be 


situations is 


cause the methods used to gather them were so different 
Or suppose that interviews are used in collecting the 
reactions of participants to a program, but different 
interviewers ask different questions. The reactions of the 
participants are not comparable, since they have been 
reacting to different stimuli, To make interviews com 
parable, different standard 


methods of interviewing that have been agreed upon 


interviewers should use 


in advan e. 


If evidence is to serve its purpose in evaluation, 
it must yield valid generalization when it is interpreted. 
For this reason, evidence must be generalizable. Evalu 
ators should be alert to two distortions of evidence which 
can thwart valid generalization. Sometimes much of the 
significance of evidence is unwittingly siphoned out be 
cause of the conditions under which it is collected. For 
example, in an organization where negative feelings about 
the program are suspected, and whe re there are inhibi 
tions about expressing these feelings publicly, a signed 
questionnaire may yield incomplete or distorted evidence 
while an anonymous questionnaire may yield a more 
honest picture 

Another type of distortion frequently occurs be 
cause the sample of people who furnish the evidence is 
somehow inadequate, (Questionnaire ’ for example, are 
frequently returned by only forty per cent of the people 
to whom they were sent. If the evidence from such a 
feelings of the 
total population, seriously erroneous conclusions may 
be reached. Maybe only the discontented people re 


questionnaire is used to describe the 


sponded to the questionnaire, Maybe only those who 
felt’ very good responded, The chances for distortion 
through inadequate sampling can be greatly reduced if 
the evaluators bear two questions in mind. Did we 
tap all of the significantly different reactions, attitudes 
and ty pes of adjustment to the program in our question 
naires, interviews or observations? And did we tap them 
in the same proportion as they occur in the total popu 


lation of participants 7 
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Safequarding Interpretation 


use of its results, either because they see it as some- 
thing being done to them from the outside, or because 


con 
The values and feelings of the interpreters may they do not understand what changes in practice are oe 
also distort the meaning of evidence. To make interpre implied by the results. On the other hand, the people as 
tation less subjective it may be desirable to have several working in a program usually aren’t experts in collect- 
people with quite different attitudes and values work at ing or interpreting evidence. They may lack the tech- the 
interpreting the data, and then make an effort to niques to put in safeguards against poor evidence or poor oon 
reconcile the differences that show up and to achieve a interpretations. How can experts be used in evaluation wi 
common interpretation. Bringing in outsiders who are without taking over the decisions which rightly belong om 
less identified with the program to check the interpre to those responsible for the program? of 
tations of the insiders may also help increase objectivity. There is no simple answer to this problem. Prob- Co; 
ably the safest rule is that the policy decisions about ser 
what needs to be evaluated rest always with the organ pre 
Using Lxperts on Evidence ization. Decisions anon the expert help needed and vo 
it is needed should also be made by the organization, Ev; 
A perennial problem of program evaluators is how perhaps in consultation with outside experts. In many dex 
to achieve a balance between expert competence in col cases of thoroughgoing evaluation, expert help of various ach 
lecting and interpreting evidence and the competences sorts will be needed. The experts may be used to do some sho 
of the practitioners who are running the program. The of the evidence-gathering, or they may be used to train 
people who are conducting the program are the ones who members of the organization to carry it out. In general, ven 
will use the results of the evaluation in improving pro the latter is preferable, since it leaves the organization che 
gram and performance. ‘This means that they should be less dependent on outside experts when further evalua- ing 
in on planning what data need to be collected and in tion is undertaken. All evaluation which leads to lasting 
on =! core and interpreting the evidence on which improvement in an organization must become self-evalu- 
the evaluation is based. If they aren’t active in the ation. Expertness should be used to facilitate this de 
process of evaluation, they are likely to resist making velopment, not to eliminate it. 
| Goal 
| a » 
Kvaluating Goals 
org 
coo 
Have you ever puzzled over how to evaluate the goals as well as the methods of 
a group? If so, this short discussion, Ulustrated from the experience of a coun- 
cil of community organizations, may suggest how to tackle a review of goals. 
To 
age! 
By periodic review of its goals an organization o1 achieving or trying to achieve any particular goal. Then in | 
group can help adapt its program to changing needs we need to think about these actual and anticipated con- owr 
both within the organization and in the society outside. sequences. Are they the outcomes we really want? Does 
It can also find opportunities to change its aims in achieving our goals result also in unintended consequences tion 
accordance with its accumulating experience. This is that we don’t want to bring about? Or in unintended forr 
obvious enough, but when we try to evaluate goals we consequences that come as pleasant surprises? part 
immediately run into a problem that may be stated The answers to any or all of these questions might 
follows: indicate a need to modify our goals in some way. 
“We use our goals as standards when we evalu- We all make assumptions about the values of achieve- 
ate methods, What, then, shall we use as stand- nak Gia: sels we tdi ah, talk conten hens: mene 
ards when we evaluate goals , tions, when tested im experience, are belied by the facts. 
Here are a few standards that have been found useful. co ; 
A goal should be: rhey may, of course, be confirmed by the facts, Thi 
D ashloushle and this confirmation will strengthen our confidence in y ‘| 
2. in harmony with other goals to which we the goals we are pursuing and deepen our commitment S wil 
are committed to them. [ i : 
3. such that the process of achieving it enables The experience of the Community Council of Greater ~ a 
us to conceive and move toward further goals, Lakeport illustrates the application of some of these ideas ' eae 
as we perceive these on the basis of new or more in an important field of organizational activity. A little x of tl 
extensive experience. more than two years ago most of the Lakeport agencies ous 
To evaluate goals we need not only standards, but facts and organizations which sponsored voluntary adult : 
as well. We need to know what are the consequences of groups formed the Council order to “achieve greater — 
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cooperation and eliminate unnecessary duplication in the 
member organizations’ educational and recreational serv- 
ices to the community.” 

Some of the organizations were highly skeptical of 
the value of the Council and had agreed to send repre- 
sentatives partly because they didn’t want to appear un- 
cooperative and partly to see that the Council didn’t do 
anything that would endanger their interests. But most 
of the organizations were genuinely hopeful that the 
Council would give them all a better picture of what 
services were available in Lakeport and thus help to 
prevent needless and expensive overlapping. 

After 18 months of activity the Council set up an 
Evaluation Committee to help its member organizations 
decide whether the goals of the Council were being 
achieved and, if so, whether the same or modified goals 
should be pursued in the future. 

The Committee’s first action was to develop an in- 
ventory of cooperation. This inventory was an itemized 
check list of many possible types of cooperation, cover- 
ing such areas as: 


a. Co-sponsorship of programs 

b. Co-sponsorship of research and evaluation 

ce. Sharing of facilities, equipment, and physi- 
cal resources. 

d. Sharing of leadership 

e. Sharing of advice on program and procedure 

f. Joint promotion 

g- Joint planning 

h. Joint action 


On the basis of the data the Committee grouped the 
organizations according to the degree to which they 
cooperated. They fell into four categories: 


a. Cooperates extensively 

b. Cooperates considerably 

c. Cooperates to a moderate extent 
d. Cooperates little or not at all 


To prevent unfavorable comparisons, organizations and 
agencies were not named when the information was shared 
in public. Each agency, however, was informed of its 
own “index of cooperation.” 

After obtaining agreement on a few simple defini- 
tions, the Council’s Evaluation Committee collected in- 
formation from constituent groups on such elements of 
participation as: 

Size of membership 

Total numbers attending meetings 

Numbers involved in organizational activities in 

addition to attendance at meetings 

Numbers reached through radio and TV 

Number of pieces of literature distributed 


This information substantiated the findings of research 
and of experience elsewhere. That is, the organizations 
with higher indices of cooperation, had higher attendance 
at meetings, higher membership, and a higher percentage 
of active members. This experience belied the fears 
organizations often have that if they share the secrets 
of their success, they will give undue advantage to other 


organizations and will lose out through competition. 
The Evaluation Committee also developed the fol- 
lowing questions and encouraged cooperating organiza- 
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tions to include them in the evaluation materials used 
with their members at the close of the season's activities. 


| thought the program of this organization this 
year was of extremely great - 
=, little 
to the community. 

| think the program of this organization this 
year was of no —__., little 
high . extremely great 
the nation. 

| think our programs ought to deal more with 
local ., State 


Oe 


moderate , no ..... significance 


., moderate ___-_, 
importance to 


, national — , interna- 


tional problems. 


Several organizations interested in public affairs 
used these questions. The Evaluation Committee noted 
that approval of programs by members was often higher 
in those groups which most extensively cooperated with 
other groups. 

A few questions, included in a sampling survey of 
public opinion which was conducted by a newspaper, 
were designed to reveal how aware the general publi 
was of community organizations and agencies. Othe: 
questions probed into how people felt toward these pre 
grams. The responses to these questions showed that 
those organizations which rated highest in the index of 
cooperation were most widely and favorably known to 
the public and that a considerable amount of cooperation 
was more important in gatning recognition than any 
considerations of budget, size of staff or membership. 

By checking with organization leaders, the Evalu- 
ation Committee tried to identify changes in objectives, 
program, procedures, and methods of working stimu- 
lated in member organizations by the exchange of infor- 
mation provided through cooperative association in the 
Council. While such an assessment was admittedly crude, 
it was significant that there was an increased sensitivity 
to need and more ideas for serving need in cooperating 
organizations, 


Their examination of the consequences of coopera 
tion convinced organizational leaders that cooperation 
paid as a means of achieving the goals of their organiza 
tions. The new “goal” of cooperation had served as a 
“mean to further the achievement of other, longer 
established goals. 

The examination also led the Council to set new 
goals for itself. The success of the Council's program 
of furthering cooperation through collecting and ex 
changing information encouraged it to go a step further 
and to develop a cooperative research project and a co 
operative referral service. 

The goal of the Greater Lakeport Community Coun 
cil passed three important tests of adequacy: 


1. it was within the means of the Council to 
achieve; 


2. it was in harmony with, and supported, 


other goals seen as desirable by the oryaniza- 
tions concerned ; 


3. its realization made it possible for the Coun- 
cil to set and work toward wider, newly-per- 
ceived goals. 
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an iuterrogation 


Lawrence Frank ’s View’ 


What do you think should be the basic goals of the 


adult education movement in the United States today? 


MPHE basic goals of adult education may be found in our 

-prraeaeed, aspirations. These express our faith in 
people, in their ability to think, to learn, to govern them- 
selves. Our goals are based on a belief that it is both 
possible and de sirable. both feasible and necessary, to 
maintain a self-correcting, self-repairing, self-adjusting 
social order, 

Our social order must be continually altered as we 
strive for a democratic way of life. Our established legal, 
political, economic, family, religious, educational and 
other institutions and practices must be continually 
adapted along with our changing ways of life. Our ac- 
cepted beliefs and assumptions must also be continually 
revised and reformulated as we gain new knowledge and 
understanding. 

To work out these adjustments and corrections we 
rely not upon coercior and regimentation but upon self. 
education and increasing understanding by all members 
of society 

The aim of adult education is to help people learn 
how to see themselves and their society more clearly, to 
think about their problems more critically, and to try to 
cope with them more intelligently and creatively. These 
tasks can be achieved only by healthy, mature persons, 
Adult education should seek, above all, to foster healthy 
pe rsonalities in order to maintain a healthy society. 

Scientists, artists, physic tans, engineers, must con- 
tinually criticise and revise their assumptions and tech 
niques in the light of growing knowledge and experience, 
In the same way, all members of our social order (which, 
like science, art, medicine or engineering, is a human 
enterprise) must learn to continually criticise and revise 
their ways of thinking and acting as the only way of 


approat hing our democratic goal values. 


While legislation and other formal actions are neces- 
sary to put many social changes into effect, the actual 
process of change takes place in the minds and hearts of 
individual men and women and in their relationships to 
other men and women. We are all faced nowadays with the 
necessity of altering our customary patterns and habits. 
We all need help in understanding these necessary changes 
and accepting them in our daily lives—at home, at work, 
in neighborhood and community. We need help in making 
these transitions with the least possible personal demorali- 
zation and social turmoil. We need to learn how to work 


out these adjustments together. 


To help men and women cope with social change, the 
adult education movement should seek to focus the con- 
cern of adults—in all their varied roles and activities 
upon their essential responsibilities as members of a free 
society. Every individual today has the high privilege and 
the heavy responsibility of re-examining his beliefs, his 
conduct, his relationships, in the light of new ideas, new 
ways of testing beliefs, now becoming available. Adult 
education should help us all to participate in this process 
of social self-repair and renewal as a way of reaching 


toward our basic democratic aspirations. 


Which social factors and conditions help us and 
which hinder us in formulating and achieving these 
goals of adult education? 


N these times, people are perplexed and confused by 
rapid changes that are making so many long-accepted 
beliefs and patterns of living obsolete, even when they 
haven't recognized the fact of obsolescence. We have not 
yet learned fully to live with the automobile, and we now 
are expected to learn to live with atomic energy. We 
haven't learned to think clearly in national or hemispheric 
terms and we are now forced by events to think in terms 


of a world community. 
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We are hindered in formulating and achieving the 
basic goals of adult education by our individual uncer- 
tainties arising from the disruption of personal, face to 
face, neighbor to neighbor, friend to friend relationships, 
the breakdown of the former close-knit community, the 
mushrooming rise of urbanized industrial regions. 

The growth of our technological system is creating 
stresses and confusions in our social order, because it 
produces conflicts within our traditions, legal and moral 
codes and authorities. We have no clear common answer 
to the question: “What can and should I, as an individual 
citizen, do about crime or narcotics or local government or 
race relations or world peace?” Even when we join (or 
organize ) a group to improve our school or promote 
international understanding, we often feel frustrated, help- 
less. Too often our committees report that the task of 
building safer highways or cleaning up the slums is not 
beyond the possibility of accomplishment but is beyond 
the power of a small group working within a time limit. 

We are torn by so many demands for our time and 
attention that we often become apathetic and discouraged. 

Paradoxic ally, the very number of answers, solutions, 
panaceas that are thrust before us, adds to our confusions. 
The very multiplicity of hopefully helpful advisors—the 
eager army of counselors, commentators, columnists, ex- 
perts, agencies, committees, commissions and councils 
increases our perplexity. 

Another obstacle which stands between us and our 
democratic aspirations is our reluctance to admit that 
many of our traditional beliefs and institutionalized habits 
have become outmoded. Because we are reluctant to admit 
they are no longer effective, we like to blame someone else 
for our failures and frustrations, in order to release our 
anxieties and resentments. Unable to escape the need for 
change, we are caught between the desire for advance and 
the temptation to regress whether by driving our schools 
back to the three R's, favoring isolationism, or demanding 
curbs on criticism, question and dissent. Some of us would 
like to revert to the “idyllic yesterday” that seems in retro- 
spect so safe and certain. We forget, however, that our 
forefathers faced equivalent uncertainties and equal chal. 
lenges in their day and courageously created institutions 
and a way of life expressive of enduring democratic goals 
as they understood them. 

But on the positive side, we have more leisure time, 
more education, more widespread literacy, more oppor 
tunity and more energy for new and fulfilling interests 
and activities. We are better prepared than ever before to 
continue our education as adults. 

More importantly, in some areas of life we are be 
coming less inclined to rely on unexamined, traditional 
beliefs and practices. We are beginning to look to science 
for more practical and realistic approaches to our prob- 
lems. We are beginning to try to apply recent insights and 


*The mind of Lawrence K. Frank has ranged 
widely through all of the social sciences. pure 
And he has brought fresh and 
insights into 


and applic d 


Hluminating every phase of 
science about which he has written. He 
is an author and consultant to the Cold Spring 
Project, the Merrill-Palmer School in Detroit, 
and the Jewish Board of Cuardians in New 


York City. 
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new ways of thinking in working out solutions. In some 
areas we have achieved considerable progress——as in the 
agricultural extension system, which is increasingly trans 
lating the results of research in the laboratory to the 
farmer in his field. In other areas, we are only beginning 

as in the field of applying modern scientific thinking 
and problem solving to our personal and social relations. 


More and 


humanly desirable answers to our problems and construc- 


more we are trying to find intelligent, 


tive ways of resolving our anxieties. Many of our search 


ings—in classes and courses, in discussion and action 


groups—are recognized as adult education, Many other 
activities may not be called adult education but are ae- 
tually educational in effect. Most of the things we do have 
some educational aspect positive or negative. When we 
sing in a choir, or square dance, or attend a union meet 
ing, we are learning to communicate and share with other 
people, and we are learning how to do things with them. 
We seek advice and reorientation from psychiatrists, psy 
chologists, social workers and counselors of all kinds, We 
turn to the radio, TV, 


books, periodicals for information and guidance, al- 


mass media—newspapers, movies, 
though sometimes we or those in control of these pow rful 


means of communication are not fully aware of their 
educational responsibilities, 
of them 


may be, there are promising and Inspiring efforts more 


In our communities, disorganized as some 
fully to deve lop agencies and services to meet our common 
needs. We join citizens committees and human-relations 
districts. We use a 
variety of informal means to improve our family living, 


commissions and. soil-conservation 
our communities, our country and our world. All of these, 
to the extent that they ree ognize the worth of the individ- 
ual personality and of human dignity, promote the basic 


goals of adult education. 


Merbert Theten’s View’ 


In what way would you say the conditions in Ameri- 
can society described by Lawrence Frank are a chal. 


lenge to adult education? 


AWRENCE FRANK assumes, | think 
s social confusions which trouble people today set the 
tasks for adult education and the adult education move 
ment. People are continually faced with the necessity of 
making choices 
but they 


be no very clear-cut standards by 


that the many 


or formulating and carrying out decisions, 
are confused and troubled because there seem to 
whit h ( hoi es can he 
made and no ¢ ommonly ace ept d rule s by whi h dee isions 
can be reached. Adult education should be concerned with 
helping people join to clear up their confusions and to 
set new standards of thought and action that are in keep 
ing with the realities of an industrial society. 

What does this view of the tasks of aduit education 
mean to us from an educational point of view? We need to 
look at the fact of the social confusion he mentions from 
two angles. First, we need to understand that confusion 
sets up problems for people to solve. In a confused situa 
tion an action which one person takes may make it harder 


for another person to carry out the action he wants to 
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take. As the number of people involved in a confused 
situation increases, the more difficult it becomes for each 
one to carry out any action. The problems generated in 
this way are social problems because the efforts of more 
than one person (sometimes of many people ) are needed 
to vet the problems solved. In other words, if we are to 
clear up social confusions, we are going to have to do so 
by the jornt action and combined resources of groups of 
people 

Second, we need to understand that a confused situa 
tion forces people in it to learn. They find that their 
ittitudes, beliefs, and habits conflict with the different 
attitudes, beliefs and habits of other people. Aithough they 
want to solve their proble ms as they see these, they are at 
the same time often reluctant to give up their present ways 
of interpreting and valuing their thoughts and actions. Yet 
if part of the confusion lies in conflicting outlooks, they 
will not be able to solve their problems without making 
ome changes in their beliefs and attitudes, without re 
learning, however much they may also need to work on 
the external aspects of the situation. 

Sor ial confusion poses soc ial problems for people to 
solve by action and it necessitates that they do some re 
learning of their belie{s and attitudes. \ think it is impor- 
tant that these aspects of social confusion be seen together. 
As | see it, the situations for the education of adults must 
be learning-action situations. Only through action can 
people get any kind of test of the learning they have done. 
For this reason learning is not complete without action. 
And the difficulties in action which people feel motivate 
and guide the processes of re-learning. 


‘ 


2 Would you explain what you think the present re- 
sponsibilities of adult leadership are? 


l* understanding what the adult leader can do, it is 


important to take the concept of the learning-action 


situation into consideration. If people are to handle a 
learning-action situation effectively, they must face and 
accept the realities of that situation and develop ways of 
dealing with those realities effectively. The first job of a 
leader is to help his group of people face the realities of 
their situation. We need reality-centered leadership 

It is import int that leaders and groups face all of the 
relevant realities, not just some of these. Otherwise, prob- 
lems will not be solved and some needed learnings will be 
neglected. The realities of a learning-action situation are 
of three kinds the realities of the physical world, of the 
social world and of the personal world. F 

Any person with sufficient scientific training or with 
access to accumulated scientific knowledge can come to 
understand in general what the realities of the physical 
world are. He does not need other people around him to 
get the understanding he needs. He does not have to be a 
member of a group in order to educate himself about 
physical realities. 

The case is different with social realities. These 
realities include established powell relations, hierarchies 
of status, standards and rules set for the control of social 
effort. And these realities are not independent from the 
group of people affected by them. They are determined or 
legislated by the group. Some of these are formulated and 
written down, in our laws for example. But others we hold 


at the subconscious level, and they interfere with our 
thinking and working together, without anyone’s being 
aware that they interfere or even that they exist. Even 
where they are written down or put into words, people give 
different meanings to the “same” norms or sets of stand 
ards. People have to learn to probe these realities in orde} 
to face them. And a group of people can face them better 
than an individual can by himself. One of the duties of 
leadership is to help a group learn to face the social 
realities which are part of the problem to be solved. 

Realities of the personal world——personalities and 
interpersonal relationships have to be taken into a 
count, too, when people are trying to clarify confusion 
through discussion and action. We usually deal with 
personal realities at the gossip level as we interpret and 
judge the behavior of others. But leadership here has the 
job of helping the members of a group realize that people 
and their problems are significant to the group as a whole 
only to the extent that these people or their personal prob 
lems help or hinder the group in performing its task or 
solving its problem. In other words, leadership has the job 
of helping people become more objective and less judg 
mental in facing the personal realities of the members of a 
group and in assessing these realities as part of the 
problem to be solved. 

Any group of people which is going to get anywher: 
in working on a problem will need to decide what the 
extent or limits of its problem are and agree on standards 
and rules for guiding its own behavior as a group. 
Unless a group reaches such agreements, it is hard for 
members to assess their abilities and functions, to take 
part in group tasks, and to participate in determining and 
carrying out procedures for action. A group needs to 
understand its own standards and rules in order to modify 
or change them when they interfere with the group's 
process of solving a problem. Any effective learning-action 
group needs, therefore, to study its own patterns and 
processes of operation as a group. 

Leadership means here an ability to help a group see 
the relationships between the various kinds of reality 
which are part of its problem. This requires data and 
evidence. A group needs data and evidence about its own 
operations. It also needs data and evidence about social 
realities outside the group which the group is trying to 
understand and change. One of the main tasks of adult 
leaders is to help groups to find what data and evidence 
they need, to collect and interpret it, and to change their 
plan and methods of working in the light of what they 
have learned. 

If a group is to have an adequate understanding of the 
various realities it faces and if it is to be productive in 
solving its problems, it will need people with diverse sorts 
of abilities, with different kinds of opinions, with various 
types of sensitivities. If all members of a group act alike, 


*Herbert Thelen’s primary intellectual interest 
is research into group life and community 
action. He has managed in his work at the 
University of Chicago to combine creatively 
his research interests and his concern with 


A —_J the improvement of education. 
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think alike, and feel alike, the group will be no wiser than 
any one individual in it. The variety and number of 
members needed will depend upon the problem to be 
solved, upon the realities to be faced and understood. An 
effective learning-action group does not mold its members 
into a pattern of drab conformity. It honors and cultivates 
individual differences in the groap because they help it 
act more wisely and learn more than any individual could 
do, acting alone or studying by himself. 

I would say, finally, that leadership has the duty of 
helping a group to choose activities and problems which 
are within the power and resources of the group and its 
members to solve. A group of people needs to feel that 
what it does is significant—is important enough, difficult 
enough, necessary enough to challenge its best thinking 
and effort. But it needs also to be able to make progress in 
its action, to keep its procedures for carrying out its pro- 
gram and reaching its goals manageable and under 
control. 


Kenneth Benne’s View* 


How far do you agree with Lawrence Frank’s analysis 
of the goals of adult education and with Herbert 
Thelen’s conception of the responsibilities which fol- 
low for the adult leader? 


] AGREE with Lawrence Frank that the major task of 
adult education today is to make it possible for all 
adults to join in clarifying the social confusions of our 
time. I agree also that this means a reconstruction of out- 
moded attitudes and beliefs for the individual and a recon- 
struction of archaic patterns and institutions for the 
society. Moreover, as Frank suggests, in a changing and 
self-repairing society this doesn’t mean one big splurge of 
rethinking and relearning, of adult education, and then 
unchanging patterns and beliefs. It means rather the 
creation of continuing opportunities for reeducation in the 
society and the habit of life-long relearning and rethinking 
in the individual. 

I agree with Herbert Thelen that people will really 
accomplish remaking of their ideas and attitudes only as 
their education is closely related to their efforts to solve 
the problems of their daily lives, to their efforts to decide 
and act in a perplexing and confused social environment. 
And I share his idea that people will learn to act wisely 
only as they learn to face and to control social realities 
and personal realities which are part of the problems they 
have to solve. This means helping people to use all of the 
organizations to which they belong or which they may 
join as means to their reeducation. It means also a reality- 
centered adult leadership, able to help people probe and 
reshape the social and personal realities (to understand 
and manage themselves) in working out effective solutions 
for their difficulties. 

So far I agree. But there is one assumption in Frank’s 
statement, and perhaps in Thelen’s also, which causes me 
. trouble. Lawrence Frank seems to assume that the Ameri- 
can people have a pretty clear and common agreement on 
the meaning of our democratic values and aspirations. 
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Moreover, he seems to assume that all of us Americans 
accept the democratic ideology as our way of life without 
conflict or reservations. | wish this were true. I wish it 
because I believe we, as Americans, should educate our 
selves toward clear and common democratic convictions. 


But can we safely assume such convictions? I doubt 
if we Americans have a common understanding of what 
democracy means, save in general, almost ritualistic, 
terms. | doubt if we are whole-heartedly committed to the 
ideas and values of democracy in all of our working rela- 
tionships, in our jobs, in our homes, in our schools and 
our churches. Isn’t each of us in continual danger of 
identifying what he happens to believe deeply or what 
his occupational froup or his sor ial class believes, with 
democracy? And since these beliefs of various individu- 
als dont agree but conflict at points, sometimes deeply, 
this identification doesn’t resolve the conflicts in belief 
which exist in our society. It merely further confuses the 
meaning of democracy. And, since “democracy” is a 
sacred word for most of us, something we ought to believe 
in, we merely add to our actual conflicts and difference 
the unctuous horror of a holy war in which we try to 
prove that | and mine are the true believers and the 
others who disagree are heretics and dissenters to be 
converted, suppressed or, in extreme cases of disagree 
ment, destroyed. 


The conflict really goes deeper than a conflict between 
persons and groups. It is also a conflict within the mind 
and person of each of us. Each of us lives and moves in 
several groups, not one. And these different groups are 
unevenly democratized. Our family may accept and live 
democracy; the place where we work may operate on quite 
different notions of interpersonal relations and social con 
trol. Or the opposite may be true, The point is, we incor 
porate democratic and non-democratic values and stand 
ards in the very fabric of our personal lives. We have ways 
of easing the internal conflict——“democracy” is all right in 
theory but in practice it won't work—or-——“democracy” 
works when you don’t have to be efficient but where it’s a 
matter of dollars and cents you have to be efficient first. 
Probably less often we face the conflicts directly, clarify 
our democratic values relative to the realities of our situa 
tion, and put our clarified values to the test of action and 
evaluation. 


) What role does your analysis suggest for ADULT 
LEADERSHIP? 


F I am right about the conflicts in the basic ideology of 
American people today, it is dangerously misleading to 
assume that we as Americans are through and through 


democratic in our standards and goals of human relation- 
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*As a student of educational philosophy, 
Kenneth D. Benne has spent many years in 
clarifying the ideas and ideals of democracy 
as a way of life. Convinced that education for 


wisdom requires both ethical and = scientify 
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disciplines, he has tried to see these two di 
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ships and social effort. The task of adult education must be 
in part uncovering to ourselves our conflicts in basic 
values and he Ip in building common democratic values to 
guide our thinking and our action. Adult leadership, 
aware of its educational responsibilities, must learn to 
lead people in philosophizing about basic values, espe- 
cially the values of democracy and its alternatives, as well 
as in developing realistic and informed plans and pro- 


grams of action. 


1 Will you suggest more specifically where you see 
American people as ideologically divided between 


democracy and other ideologies? 


WILL try. Let’s illustrate these conflicts in the area of 

ideals relative to leadership and social control. No 
adult leader concerned with his role can rightly avoid 
facing these conflicts in himself and in his organization. 

Two non-democrati« ideologies of leadership are just 
as authentically parts of the American tradition as are 
democratic goals and assumptions. It is precisely because 
they are authentic elements in our tradition and culture 
that we cannot safely assume that we are through-and- 
through democratic or that we need give no explic it edu- 
cational attention to ideologies as well as to knowledges, 
methods and skills, 

One of these we may call the individualistic concep- 
tion of man and society. The assumption here is that 
individual persons are basically atoms, not unique organi- 
zations of social relationships and processes. Individual 
interests, on this view, are irreconcilable. Common inter- 
ests cannot be developed through joint deliberation and 
learning. Efforts to develop common interests among 
persons are resisted as necessarily affronts to individuality, 
however much individuals participate in controlling and 
directing these efforts. The task of leadership is not to 
work toward consensus but rather to work out compro- 
mises among irreconcilable interests. The policy-making 
situation is not a learning situation in which new common 
interests are forged out of the controlled conflict of differ- 
ing interests. It ie rather a balancing of power among 
competing individual and partisan interests with these 
interests going through the discussion and deliberation 
unchanged. Our parliamentary system of control and de- 
cision in many respects reflects this individualistic con- 
ception of man and society and of leadership. While it has 
elements in common with a democratic conception, it 


seems to me non-democratic in important respects. 


oo Here are some of the other writings of the three authors 
of this article in case you wish to explore their ideas 
further: 


Frank, Lawrence K, Nature and Human Nature: Man's New 
Image of Himself, New Brunswick, N. J.: Rutgers University 
Press, 1951. 

Frank, Lawrence K. Society as the Patient, New Brunswick, N. J.: 
Rutgers University Press, 1948 
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Or take another ideology. Here it is assumed that 
wise policies cannot be attained or social order main- 
tained unless a special leadership group is in control. 
Some people are regarded as inherently better able to lead 
than others—whether through aristocratic birth, native 
endowment or special access to truth. It is the task of the 
leadership group to set goals and evaluate purposes. The 
rank and file are brought in to implement goals which are 
set by those lepitimately in authority. Theirs not to reason 
why. Theirs but to follow the dictates of a wisdom in 
which they can never fully share. The task of adult leader- 
ship (except for the originators at the apex of social con- 
trol) is to funnel the wisdom of the policy makers to the 
rank and file, to sell them on the decreed goals, to per- 
suade them to lend their efforts to achieving them. 


Here, all too simply stated, are authentic alternatives 
to a democratic ideology of leadership and social control 
within American practice and tradition. The democratic 
conception has already been discussed by Frank and 
Thelen. It assumes that persons are part and parcel of the 
social fabric, though unique and precious centers of choice 
and judgment within it. It assumes that persons can to- 
gether face a common reality of problems and difficulties 
and work jointly toward a common view and a common 
program of self-control and self-pre pelled action. It 
affirms that a social policy is poorer than it need be unless 
it incorporates the insights of all unique individuals 
affected by it in its development. It assumes, simply but 
fundamentally, that individuals can learn from each other 
in deliberation and become the better for it, that the 
common view is ketter than the individual view, if the 
conditions of its working out are genuinely cooperative. 
It is the task of leadership, in the democratic view, to help 
people develop and establish these conditions of coopera. 
tive learning and action throughout the fabric of their 
lives. 


You may not accept my version of democratic 
ideology as over against individualistic and authoritarian 
ideologies. But, if you don’t, that illustrates my main 
point. We don’t agree, as good Americans, on the basic 
meaning of democracy. So we can’t assume such agree- 
ment in exercising leadership or in establishing programs 
of adult education. An important part of the task of adult 
education and leadership is to help people develop clear 
and common convictions about democracy which can 
guide them in building an America and a world worthy of 
man's best dreams of man and of human relationships. 


Thelen, Herbert, “Educational Dynamics: Theory and Research,” 
Journal of Social Issues, Vol. V1, No. 2, 1950. 

Thelen, Herbert, “Engineering Research and Curriculum Building,” 
Journal of Educational Research, April, 1948. pp. 577-96. 

Benne, Kenneth D. A Conception of Authority, New York: 
Teachers College, Columbia University, Bureau of Publications, 
1943, 

Benne, Kenneth D. (with Raup, Smith and Axtelle) The Improve- 
ment of Practical Intelligence, New York: Harper and Brothers, 
1950, 
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consultation, please 


CAN 


Based ona report submitted by BERN ICE Tl RK, Educa- 
tion Chairman, Ithaca Branch, American Association of 
University Women, Ithaca, N. Y. 


FAST September 21st, 90 women meeting in Ithaca, New 

York were busy pondering the problems of leadership. 
They were attending a “Group Discussion Clinic,” part of 
an Area Conference of the New York State Division of the 
American Association of University Women. Under the 
leadership of Mr. Gordon Cummings of Cornell Univer- 
sity, the Clinic was organized so that half the group de- 
lineated problems while the other half served as consultant 
on ways of solving them. 

Thanks to the that 
drew up the report of the Clinic and 
it to ADULT LEADERSHIP 
for evaluation, AL readers can share 
in the results of the Clinic. Because 
the committee considers the Clinic 


committee 


sent 


an experiment in training and wants 
other AAUW Branches and other 
groups to be able to profit from its 
experience, it is 


inxious to have 


comments from other leaders on: 


1. The method used by the Clinic. 
2. The problems identified. 
3. The solutions proposed, 


After reading the report of the 
Clinic, please send your reactions, 
suggestions, or ideas about the ma- 
terial in the report, or the method 
used to “Consultation, Please.” 
ADULT LEADERSHIP, 743 N. 
Wabash Ave.., Chicago 11, Hlinois. 
Your comments, along with those of AL’s editors, will 


appear in the June issue of ADULT LEADERSHIP. 


The Conference was divided into two sections. 

Each section was divided into buzz groups of 6-8 
persons, and chairmen were selected for each buzz 
group. 

The buzz groups in the first section were asked to 
consider the question: “As members of AAUW 
branches, what are the problems you have experi- 
enced in group discussion?” 

The buzz groups in the second section were asked to 
anticipate the problems that would be raised by the 
first group, and to list the techniques or solutions for 
handling these problems. 

After twenty minutes, reports were called for. Each 
chairman in the first group was called in turn to list a 
problem. As each problem was presented, a chairman 
in the second group was called on for a suggested 


solution. 


april, 1953 
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Planning Committee for 
Mr. Gordon Cummings, Mrs. R 


A GROUP BE ITS OWN CONSULTANT? 


6. A committee was chosen to work up a report of the 
problems and solutions to send to each represented 
AAUW branch, as time did not permit adequate con- 
sideration of all the problems and solutions. 


How do we get discussion underway? 
1. Preliminary planning on part of ieaders and mem- 
bers when and where possible. 
Provide opportunity for participants to meet and 
visit informally in order that they may become better 
acquainted before the discussion starts. Serving light 


refreshments and providing name identification tags 


Mrs. K. L. Turk, 
John Vandervort 


AAUW Group Discussion Clinie /. to 4 
F. McElwee, Mrs. J. W. Connor, Mre 


helps to bring people into contact. The leader has the 
primary responsibility for seeing that understanding 
and good communications within the group are 
readily established. 

Raise questions that are within the personal experi 
ence and interest of the members. 

Make certain that the topic is re lated to the interest of 
the group and appropriate to the effort they are 
willing to expend in its consideration. 


How can we avoid trying to cover too much ground in a 
discussion period? 


goals the 


|. Pre-plan the discussion period to suggest 5 


group might be expected to reach within the time 
allotted. 
Agree on limits before the discussion moves along 
very far. 


How can we avoid digressiona from the topic? 
1. The discussion leader or any member may ask the 


recorder or group observer to present a summary of 
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developments, starting with what the group decided 
as its task and what progress it has made up to this 
point. 

2. Raise questions to clarify what the goals of the dis- 


cussion are. 


How can we get the necessary background and facts on 
a topic with minimum time-loss? 
|, Divide responsibility among members for digging up 
needed information. 
2. Prepare a file on places and persons (resources) 
where needed information is available. 
3. Call in outside experts as resource persons to provide 


facts and considered opinions, 


How can we get across the idea that equality in human 
relations during the discussion is important and related 
to solving the problem? 

1. Practice good human relations during discussion. 

2. Entertain all ideas and proposed solutions prior to 


making decisions 


How can we deal with a person who dominates the discus- 
sion and at the same time maintain harmonious relations 
among group members? OR How can, we handle the ap- 
parently uninformed person who just likes to talk? 

1, On controversial aspects of a topic, limit the number 
of times a person may speak as well as how long. 

2. Select a discussion leader who has had experience 
and knows how to use tact in dealing with such 
people. 

%. Handling this problem is primarily one of group 
responsibility and not necessarily the sole responsi- 
bility of the leader. The most talkative person has to 
stop or pause sometime for air. At this point any 
member should be prepared to enter the discussion 
to make her contribution as well as to encourage 
others to express their ideas. 

1. The techniques listed under avoiding digressions are 


applicable to this problem. 


How can we encourage shy people to participate in discus- 


sion without embarrassing the reluctant participant? 


1. The leader may call upon the non-participant for an 
opinion about a spec i fic aspect of the topi prov iding 


Talking /t Over continued from page 1 


she (the leader) has some reason to think the person 
has some interest or experience with this phase of the 
topic. 

2. The shy person may be brought into the discussion 
by reading a report she has previously prepared in 
connection with the topic. 

3. When there is a need for a special committee to study 
some aspect of the topic, assign the shy person to a 
group that is aware of her difficulties and will take an 
interest in helping her to overcome them. People are 
more apt to express themselves in smaller groups. 
Once they have gained some confidence they may be 
encouraged to speak out in the larger group. 


How can we make constructive use of emotional outbursts 

during discussion? , 

1. Momentary silence-the “Quaker Method”—and 
then move on. 

2. Avoid reacting to emotion with emotion. 

3. When the “emoting person” pauses, she may be 
asked to repeat her remarks for the purpose of clarifi- 
cation. This may help her to see that her manner of 
speaking has not been very effective in conveying an 
understanding of her views. 

4. If a person’s feelings are deeply involved in an issue 
it may be well to suggest that consideration of the 
issue be postponed to a definite time in the future 
after all members have had an opportunity to 
examine it, 


How can we assure that members will want to return to 
continue discussion of the topic in future meetings? 

1. Allow time toward the end of discussion for the 
recorder to summarize accomplishments and to point 
out what remains to be done in order to reach objec- 
tives. 

2 Ask members to agree on the time and place for the 
next meeting. 

3. Determine who is responsible for what in preparation 
for the next meeting. 

1. Try to end discussion at a point where there is 
observable satisfaction and feeling of achievement. 

». Be sure that any recommendations of the group are 


put into action as agreed, 


il. in Korea... 

We have been sharing the issues 
which we have with an English 
speaking club here in Korea and 
they have been enthusiastically re 
ceived by these young leaders. (MRS. 
WILLIAM P. COSTON, YMCA, Pu 


san, Korea.) 


Mind Your A’s and Qs... 


There should be a rule about writ 
ing up interviews. (Interview with 
Senator Paul H. Douglas, ADI LT 
LEADERSHIP, January, 1953.) Q’s 
should not be interspersed with A’s 
when A’s and ()’s are not related 


30 


Following this AQA routine gives the 
interview an appearance of sequitur 
ishness. This is very baffling. For 
instance--Q. At what level of the 
hierarchy do you perform your fun 
tion? A. I do most of my work on 
the third floor but sometimes we 
work up higher. Q. And would you 
say within the hierarchical structure 
that yours is a line or a staff func 
tion? A. We do feed people a good 
line once in a while... but most of 
the time I'd say we're pretty well 
staffed .. . Q. You would say then 

your function is in both the line 
and the staff? 


My sympathy is all with the 
vietim who has to come up with the 
answers. I only hope I never get 
trapped on the wrong end of a “tech- 
nical” interview. Two dozen roses to 
one of my favorite senators, and any 
good book on semantics to AL. 
(BERNICE ROGERS, Adult Read- 
ing Research Assistant, Department 
of Education, University of Chicago, 
Iilinois.) 


|For Professional Reader Rogers’ 
information, AL’s “victim” O.K.’d 
the text before ul appeared. The 


Editors.\4 
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RESOURCES 


WHERE TO FIND PUBLIC HEALTH INFORMATION 
Prepared with the Cooperation of S.S. LIFSON and GENEVIEV! 


H {IRKIN, National Tubere ulosis 


PUBLIC HEALTH DIRECTORIES 
National Health Agencies, National 
Health Council, 1790 Broadway, New York 
19, N.Y. 

Outlines organization and activities of 35 
major public health agencies. 


Handbook for School Administrators. 
Health Vublications Institute, Inc. Raleigh, 
N:C. 50. 

Describes purpose and program of 62 
member agencies of the National Confer 
ence for Cooperation in Health Education. 


OFFICIAL AGENCIES 
Federal Security Ageney, Washington 
25, D.C. 

Maintains 10 regional offices in the U.S. 
which provide consultation service to state 
health, welfare and education departments. 
Numerous printed and audio-visual ma 
terials produced by this agency are avail 
able through state divisions of health, wel 
fare and education. 


United States Public Health Service, 
Washington 25, D.C. 

Maintains a Division of Public Health 
Education with a staff of trained health 
educators who are available for consulta 
tion on health education programs. 


United States Office of Education, 
Washington 25, D.C. 

Provides consultation services and ma- 
terials, conducts research and education in 
school and adult health education 


United States Children’s Bureau, Wash 
ington 3, BA. 

Gives advisory service on health, social 
service, welfare legislation and research on 
all phases of maternal and child health. 


VOLUNTARY HEALTH AGENCIES 
American Cancer Society, 47 Beaver 
St., New Yerk 4, N.Y. 

Provides a year-round program of edu 
cation, research and service to promote 
cancer control, 


American Hearing Society, 817 Four 
teenth St., Washington 5, D.C. 

Provides consultation to help establish 
services and facilities to prevent deafness, 
conserve hearing, and assist in rehabilita 
tion of the hard of hearing. 


American Heart Association, 44 Fast 
3rd a New York 10, NLY. 

Pramotes understanding and action on 
diseases of the he irt and the circulatory 
system through research, community service 
and education. 


{ssociation, New York City. 


American National Red Cross, | (th and 
D Sts., Washington 13, D.C, 

Promotes good personal and community 
health by preventing and alleviating human 
suffering and national calamities. Provides 
courses on safety, first aid, home nursing 
ind nutrition, 


American Social Hygiene Association, 
1790 Broadway, New York 19, N.Y. 

Offers an education program to strength 
en and protect American family life. Pub 
lishes materials for youth and adults on 
hygiene and sex education. 


National Association for Mental Health, 
1790 Broadway, New York 19, N.Y. 

Promotes the prevention of mental and 
nervous disorders, the improved treatment 
of mentally ill and special training of men 
tally deficient. 


National Foundation for Infantile 
Paralysis, 120 Broadway, New York 5, 
N.Y. 

Aids polio patients and collaborates with 
medical and health authorities in research, 
professional and public education programs. 


National Society for Crippled Children 
and Adults, || S. La Salle St., Chicago 3, 
il 

Works for a comprehensive program of 
education, research and direct service to 
assist the crippled and handicapped of all 


ages 


National Society for the Prevention of 
Blindness, 1790 Broadway, New York 19 
N.Y. 

Stimulates and coordinates activities to 
prevent blindness through research, demon 
strations, and consultations, 


National Tuberculosis Association, 1790 
Broadway, New York 19, N.Y 
Promotes prevention and control of tuber 


culosis through arousing community sup 


port for finding cases, diagnosis, treatment 
and rehabilitation services for community 
and individual health, 


This is a partial ‘st of sources for 
consultation and materiols on adult health 
education programs, Since many of these 
national agencies have state and local 
counterparts, it is suggested that inquiries 
regarding services he made first to the 
unit in your area. City, county, state and 
regional units of these nationa!l agencies 
offer consultation services, printed and 
sudio-visual educational materials, sponsor 
meetings and conferences, and offer numer- 
ous opportunities for citizen participation 
in solving public health problems 


ANNOUNCING A NEW SERIES, THIS | FIND IMPORTANT 


‘ What are the tasks of adult leaders in a changing world? In a series of concise statements be 
@nning with the coming issue (May 1953) national and international leaders in contemporary life 


will share their personal vision of the work that lies ahead, of the pitfalls and of the challenges 


that confront adult leaders today. 


This series is an outgrowth of the views which you as readers expressed in our contest on the 
goals and aims of adult leadership announced in our December 1952 iswe. Some of your views, 
with an analysis and commentary by Eduard C. Lindeman, will constitute the first of these articles. 
Watch for it next month and for others in the months that follow 


april, 1953 


—_ s)he | Se oe ee | 


Coming Events 


notes on... 

National Social Hyziene Day takes 
place April 22nd. May 3-9 is National 
Mental Health Week. Contact local 
branches of the health agencies listed 
to the left for materials and ideas on 
programs for these events, 

Planning Conferences and Work 
shops is the theme of an intensive clinic 
to be held April 21.23 at the Hotel 
Vanderbilt, New York City. Planners 
and managers are invited to obtain 
further information from Conference 
Counselors, 114 EF. 40th St., New York 
{ 

The Annual Adult Education Con- 
ference of the New York State Depart 
ment of Education will be held at the 
Hotel Statler, New York City, May 17- 
20. Information may be obtained from 
the Department at Albany, N.Y. 


NEW BOOKS 
Freedom and Authority in Our 
Time, ed. by Lyman Bryson, Louis 
Finkelstein, R. M. Maclver, and Richard 
P. MeKeon, N.Y.: Harper & Bros., 1953. 


$6.00 


Leaders who see their task writ large 
will find new approaches to the im 
portant questions about authority and 
freedom in this book, Seventy-five intel- 
lectual, religious and civie leaders look 
at the history and future of these two 
ideas from the point of view of the 
individual, the small group, and the 


larger society and culture 


Society —- Democracy — and the 
Group, by Alan F, Klein, N.Y.: 
Woman's Press, 1953. $4.00. 


For community leaders and = staff 
workers in all types of welfare agencies, 
this book will give new insight into the 


the democratic prin- 


social objective 
ciples and program of social group 
work agencies, The book devotes sped ial 
ittention to goals and proble ms of social 
igencies in relation to the environment 


in which they operate, 


NEW PAMPHLETS 
Handbook for Teachers of Adulta, 
California State Department of Educa 
tion, Bureau of Textbooks and Publica 
tions, Sacramento 14, Calif, Ie. 

Presents the characteristics of adult 
students and good teachers of adults; 
preparation, methods, techniques and 
procedures for self-evaluation for adult 


teachers and classes 


Teachers Prepare for Discussion 
Group Leadership. Bureau of Publi 
cations, Teachers College, Columbia 


Universit New York 27, 

Describes a cor iplete training session 
for teachers to increase their compe: 
tance as discussion group leaders. Pre 
sents the procedures used in the training 
session, a reproduction of the recording 
used as a basia for the training session, 
and the evaluation forma used during 


and after training. 
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ADULT LEADERSHIP AND ITS READERS 


@ We, the staff of ADULT LEAD.- 
ERSHIP, believe that you, the read- 
ers, are needed in any effective evalu- 
ation of the magazine. We have, dur- 
ing the first year of AL’s life, solicited 
and used the reactions of our Opera- 
tions Committee and of other experts 
in magazine production and leader- 
ship training in evaluating our prod- 
uct. But you who read and use AL 
are our best source of inforination 
about whether the materials in the 


mavazine are readable and useful. 


You are also, we feel, one of our 


primary resources for improving 
these materials. 


Acting on this conviction, we 
have asked you, mainly through the 
Reader's Report, to write us your re 
actions to AL, and your suggestions 
for its improvement. A few times we 
have asked you to help us decide 
questions of editorial policy. The 
frankness and intelligence of your 
responses have helped us to do what 


we hope has been a progressively 
better job. 


But, as we have pored over your 
letters and studied the Readers’ Re 
ports, we have become increasingly 
aware of our limitations in getting 


the help we need from our readers. 


We need to know more about you 
before we can ask your advice intel- 
ligently or imterpret your advice 
when it comes. 

For one thing, we cannot be sure 
how representative of all of you the 
reactions and suggestions we receive 
actually are. We don’t know the main 
categories of our readers in terms 
of distinctively different interests in 
the materials of AL or distinctively 
different uses to which they put these 
materials. And, of course, we don’t 
know the proportions of our readers 
who fall into each category. So we 
don't have the basis for telling just 
what the reactions we receive mean. 

This same lack of knowledge of 
you prevents us from constructing 
representative samples of readers to 
whom we can send special question 
naires or from whom we can solicit 
advice from time to time. 

| p to now we haven't had Spe 
cial research resources on our staff 
to determine what information we 
most need from you and to develop 


effective ways by which you can give 
it to us. 


Plans lor the Future 


con 


We haven't given up our 
viction about the importance of using 


Snel 


“Let me put it this way, Miss Jones——have you ever pictured yourself 
caparisoned in rose petals, designed for aesthetic flight?” 


[Where people are not self-objective, the data they 
furnish about their performance or its success are 
likely to be distorted and invalid.| 


Lhe. 62 Hie RRM BAS IS 


Ps <7 


reader reactions and suggestions in 
the operation and improvement of 
AL. But our dissatisfactions with our 
efforts to live up to this conviction 
have led us to seek support for an 
improved program of evaluation re- 
search, These are the things we plan 
to do with funds recently received for 
this purpose from the Fund for Adult 
:ducation. 

We have arranged with the Sur- 
vey Research Center of the Univer- 
sity of Michigan to conduct a survey 
of the readership of AL. The Survey 
Research Center will construct a rep- 
resentative sample of readers and, by 
interviews, get data about your prin- 
cipal reactions to AL. The Center will 
get information about your main ob- 
jections to the magazine and about 
the different uses to which different 
readers put it. By interpreting this 
data, it will be able to give us mean- 
ingful categories for our present 
readership and information about the 
proportions of readers who fall into 
the different categories. The survey 
will also tell us what information we 
should ask you to give on your re- 
newal blanks so that we can keep up 
to date in the analysis of our readers’ 
experience with AL. 

In brief, this study should give 
us the base-line data we have needed 
badly and haven't had this past year. 
To build on the results of this survey 
in continuing evaluation research, we 
are adding a qualified research per- 
son to the staff. This research director 
will work with the staff in finding 
out what kinds of data we need from 
you. And he will devise ways of ask 
ing your help in getting this data to 
us for our guidance. 

Our research director will also 
try out different patterns of using 
AL in various kinds of adult groups 
and programs and evaluate the re 
sults. As these findings accumulate, 
he should be able to furnish evalu- 
ated ideas about putting AL to work 
in different group settings. 

We need your help in operating 
and improving AL. We hope our re- 
search plans will help us to use your 
help more effectively than we have 
been able to do in the pr 
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AVAILABLE FOR 
GROUP USE .... 


MAY 1952 — “Program Plan- 
ning.” Both back issues and 
Tool Kits are available. 


JUNE 1952—Tool Kits only are 
avatlable. 


JULY-AUGUST 1952 — “Using 
Resources.” Both back issues 
and Tool Kits are available. 


Send Order NOW for Back Issues and Tool Kits! 
ADULT LEADERSHIP, 743 N. Wabash Ave., Chicago 11, Illinois 


wy ADULT LEADERSHIP is an unusval editorial workshop, pub- 


rae 
tiny 


NK 


“ 


) 


' lished monthly under a grant from the Fund for Adult Educa- 
S; yation (an organization established by the Ford Foundation) as 
| & non-profit public service for all groups, regardless cf size or 
Si @bjectives. More than 5,000 groups—cand 10,000 individuals— 
' Gre using ADULT’ LEADERSHIP now to make their group ac- 
’ " \"ivity more productive. 
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ADULT LEADERSHIP, 743 N. Wabash Ave., Chicago 11, ‘Illinois 


Yes, I would like to receive ADULT LEADERSHIP. Please enter my 
subscription for [] Three years—$9.00 (you save THREE ,POLLARS) 
[] Two Years—$7.00 (you save ONE DOLLAR) [] One Year— $4.00. 
(Canadian subscribers please add 50 cents for each year to subscrio- 
tion prices to cover increased cost of mailing. Foreign subscribers, 


please add $1.00 FOR EACH YEAR.) I enclose § 


My Organizational Interests are 
My Occupation is 


[] Bill Me. [J Payment Enclosed. (ONE EXTRA ISSUE FREE IF PAY- 
MENT ENCLOSED) 


The ONE Magazine of its Kind—-Available Only by Subscription! 
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Quantity back issues of ADULT LEADERSHIP (except June, September and Oc- 
tober, 1952) and Leadership Tool Kits are available for organization or individ. 
ual use in conducting group activities and helping to achieve your goals. Back 
issues of the magazine are 50c ea., in any quantity. Tool Kits are 20c ea.; $2.00 
per dozen; or $15.00 per 100. When ordering, please include your remittance. 
See below for availabilities. 


SEPTEMBER i352 —- “Working JANUARY 1953—''Spotlight on 
Towards Goals.” Tool Kits only Membership” (roles of group 
are available. members). Both back issues 


and Tool Kits are available. 


OCTOBER 1952—''The Group 


in the Community.” Tool kits FEBRUARY 1953 — ‘Initiating 

only are available. Secial Action.” Back issues 
. avetilable. Tool Kits not avail- 
able. 


NOVEMBER 1952—Getting and 

<eeping Members. Both back 

issues and Tool Kits are avail- MARCH 1953—''Leading Dis. 

able. cussions.” Back issues avail 
abie. Tool Kits not available. 


DECEMBER 1952 — “Leading 


Large Group Meetings.” Both APRIL 1953—'"'Improving Eval. 
back issues and Tool Kits are uation.” Back issues available. 
available. Tool Kits not available. 
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reader’s report no. II 


@ Some of you have been receiying ADULT will enable us to plan future issues and so pro- 
LEADERSHIP for a year—since Vol. 1, No. 1 vide the kind of assistance you really want.” Have 
appeared last April. The rest of you have joined we succeeded? 
us at some time between then and now. In the first 
issue, one year ago, we said, “Your participation We'd like every reader, old or new, to take part 
is so important to the success of ADULT LEAD- in our end-of-year evaluation by filling in the 


ERSHIP that an easy-to-use evaluation form will reader’s report below and mailing it to us as soon 


be included in each issue. By sending it in you as convenient. 


Considering all the issues you have seen. how would you rate 


AL as an aid to the improvement of your own work with adults? 


Clip Coupon on This Line 


EXCEILENT.......... GOOD.......... BAIR........... POOR........... VERY POOR........... 


What are the principal strengths and/or weaknesses of AL as you see them? 


Which issues have you seen? (check)1 234567891011 


My work with adult groups is: mainly on a professional (paid) basis... ~_- ; Ce eee 
mainly on a voluntary (unpaid) basis_.._.... ; both about equally...__.--. | Mail To 
ADULT 
LEADERSHIP 
Name 
Box R 


Address 743 North Wabash 


Chicago 10, Itlinois 
Organization oo er 
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